Possible "broken" URLs in FIBO PROD literals

[mereolog]

The attached table collects 500+ triples from FIBO PROD (commit: dbdd526) where the object value is a URL that possibly does not refer (any more).

fibo_prod_possibly_broken_urls_dbdd526.xlsx

The check for these is not 100% precise, e.g., the links from the https://www.ffiec.gov domain like https://www.ffiec.gov/npw/Help/InstitutionTypes or https://www.ffiec.gov/nicpubweb/Content/DataDownload/NPW%20Data%20Dictionary.pdf, are classified as 403 although you can access them via a web browser.

For a great deal of other cases, but not for all of them, the 'http' schema should be updated to the 'https'.

[ElisaKendall]

@merelog - after discussion on the FIBO DER telecon this afternoon, we think you should exclude 403 errors. We did a spot check on those, and they resolved via a browser, as you mentioned, so that "doesn't count" as broken.

[ElisaKendall]

@merelog - also per our conversation on the FIBO DER telecon, please exclude all of the ones that are identified in the MarketsIndividuals ontology in FBC - they are provided by ISO and so we have no control over what they claim is the website of the exchange or other market participant.

[mereolog]

@merelog - after discussion on the FIBO DER telecon this afternoon, we think you should exclude 403 errors. We did a spot check on those, and they resolved via a browser, as you mentioned, so that "doesn't count" as broken.

I would advise that we might check what url the browser resolves, e.g., when you sent http://www.otcmarkets.com you are being redirected to https://www.otcmarkets.com, so you can interpret some of these 403s as warnings for updates in the schema.