Missing IUE mission/instruments

[DougBurke]

After re-loading all the data, this time using the latest semflow - including rdf2solr5.py - I still don't see IUE in the missions facet or the instruments one. Could be

a) modeling issue
b) ingest issue
c) display issue

I suspect c is very unlikely since the other missions are displayed correctly. I'll look into a to begin with.

[DougBurke]

My money, at the moment, is on the fact that I have

% ls -l ../mast-rdf/iue/ total 10136 -rw-r--r-- 1 dburke staff 5189136 Jul 12 14:55 proposals.iue.rdf

so missing a few useful things, like the actual obscore values. That could just explain why I'm not seeing any IUE
data.

[DougBurke]

This appears to be due to a missing mast/ingest_iue.py file, which I'd inadvertently lost. Oh joy. Regenerating now.

[DougBurke]

I believe I have finally resolved this; the final part came down to the mapping between obsid as defined by obscore and the bibcode/obsid/proposal mapping including a difference in case as well as the substring comparison that was already being used.

[DougBurke]

Gah, not completely fixed. I have found 1995ApJ...445..314S which has plenty of IUE data - e.g.

% grep 1995ApJ...445..314S ../AstroExplorer/Missions/MAST/iue/map.iue.txt
1995ApJ...445..314S SWP37035    GHLLD
1995ApJ...445..314S SWP51085    GHQKS
1995ApJ...445..314S LWP16369    GHLLD
1995ApJ...445..314S SWP07355    UK239
1995ApJ...445..314S SWP10069    UK303
1995ApJ...445..314S SWP37036    GHLLD
1995ApJ...445..314S SWP51083    GHQKS
1995ApJ...445..314S SWP51084    GHQKS
1995ApJ...445..314S SWP51086    GHQKS
1995ApJ...445..314S LWP28409    GHQKS
1995ApJ...445..314S LWP16368    GHLLD
1995ApJ...445..314S SWP07354    UK239
1995ApJ...445..314S LWP28408    GHQKS
1995ApJ...445..314S LWP28410    GHQKS

and via MAST, but there is no mission or instrument listed in the facets [when you do a text search on the bibcode to select just this paper], and the "more" section of the paper has no data links (it does have object links).

[DougBurke]

Hmm, it looks like these obsids are not in the obscore file for IUE; e.g.

% grep -i SWP07355 ../AstroExplorer/Missions/MAST/iue/obscore.iue.psv | wc -l
       0

[DougBurke]

As a reminder to myself, we currently do not have obscore data for the echelle data, which this data is likely to be (e.g. obsid SWP37035).

As we know about these obsids from the bibliography-obsid-program map, we could add them to
RDF/Solr - saying this is an observation for IUE - so that it could be displayed to the user even though we do not
know anything about it.

[DougBurke]

Another paper is 2005ApJ...622..680R for which we have 14 IUE datasets but MAST has 16:

http://archive.stsci.edu/mastbibref.php?bibcode=2005ApJ...622..680R

The MAST link shows that they all have Disp=LOW so I assume that they are not echelle data products, although two have APER=SMALL. Ahah, there is an APER=LARGE and APER=SMALL with the same observational ids:

SWP06179  http://archive.stsci.edu/cgi-bin/mastpreview?mission=iue&dataid=swp06179
SWP07307  http://archive.stsci.edu/cgi-bin/mastpreview?mission=iue&dataid=swp07307