[New Notebook]: Demonstrate new ERDDAP endpoints and features

[MathewBiddle]

Programming Language

Python

Module/Software/IOOS data service?

ERDDAP

Module/Software/IOOS data service?

TBD

Provide a description.

ERDDAP has a few new dataset response types:

• MQTT - https://erddap.github.io/docs/server-admin/mqtt-integration
• parquet - https://erddap.github.io/changes#version-225

As well as some other services:

• Croissant - https://erddap.github.io/changes#version-2300
• metrics - https://erddap.github.io/changes#version-225

It would be helpful to create a short notebook highlighting those new features. I don't have a specific question to answer in mind. Maybe this can connect to #334 ?

[ocefpaf]

Using the idea on #334 to demonstrate these is a great idea. I think I can create something that uses parquet, and maybe explain what is and how to use croissant, but MQTT and metrics is aimed at ERDDAP maintainers and I can imagine how to make a notebook with those. Any ideas?

[MathewBiddle]

I thought MQTT was a response format?

Maybe we can use the metrics page to give us some info about the ERDDAP instance we are using? Just as a demonstration.

import requests
from prometheus_client.parser import text_string_to_metric_families

# Fetch the raw text from the application's metrics page
response = requests.get("https://erddap.ioos.us/erddap/metrics")

# Parse the text data into structured Python objects
for family in text_string_to_metric_families(response.text):
  if family.name == 'ERDDAP_build_info':
    for sample in family.samples:
        print(f"{sample.labels}")

[ocefpaf]

I thought MQTT was a response format?

I thought it was a data broker to facilitate adding data automatically for ERDDAP to serve. I may be wrong though on all the possibilities that MQTT allows, I only used it to subscribe to data before (on non-ERDDAP setups).