tag:userecho.com,2024-03-28:/feeds/topics/en//ESO Archive Community2023-09-25T12:48:18+00:00tag:esocommunity.userecho.com,2023-09-25:/knowledge-bases/26/articles/60-a-quick-guide-to-read-and-display-eso-saf-spectra-in-idl-iraf-and-python/2023-09-25T12:48:18+00:002023-09-25T12:48:18+00:00A quick guide to read and display ESO SAF spectra in IDL, IRAF, and Python [articles] <h3><strong>IDL</strong></h3><p>For <a href="http://idlastro.gsfc.nasa.gov/">IDL/astrolib</a> users, the lines below illustrate the script to read and display a binary table format file.</p><p><br></p><p>IDL> a=mrdfits('ADP.2013-09-24T15:43:19.447.fits',1)</p><p>IDL> help,a</p><p>** Structure <300fa08>, 6 tags, length=1983944, data length=1983940, refs=1:</p><p> WAVE DOUBLE Array[70855</p><p> FLUX_REDUCED FLOAT Array[70855]</p><p> ERR_REDUCED FLOAT Array[70855]</p><p> BGFLUX_REDUCED FLOAT Array[70855]</p><p> FLUX FLOAT Array[70855]</p><p> ERR FLOAT Array[70855]</p><p>IDL> plot, a.WAVE, a.FLUX, xrange=[3780, 3820]</p><p><br></p><p><br></p><h3><strong>IRAF</strong></h3><h4>IRAF SPTABLE package for tabular spectra now available!</h4><p>In September 2014, IRAF announced the <a href="http://iraf.net/article.php?story=20140924103515277">availability of the new SPTABLE package</a> (an alpha release) which provides tabular spectra support to ONEDSPEC and RV packages and tasks (e.g. splot). That package supports the tabular format adopted by ESO/SDP 1d spectral format (FITS binary tables with array cells, one single row). We recommend you to use this new external package, and to report any problem you might have either directly to the IRAF team via its <a href="http://iraf.net/forum/index.php?forum=5">external package forum</a>, or via an email to us at: usd-help@eso.org, Subject:"Phase 3 SPTABLE". After an initial testing phase of this new functionality in this external package, IRAF plans to make the tabular spectra support part of its core functionaility, with a time scale of about a year.</p><h4>IRAF generation of an ASCII file</h4><p>Within <a href="http://iraf.net/">IRAF</a>, using the tables external package (by STScI), tprint can be used to output to an ascii file the data in a tabular format (not as a list of arrays):</p><p>cl> tables<br>tables> ttools<br>ttools> tprint a.fits[1] pwidth=200 > a.txt<br>tools> !more a.txt<br></p><p># Table b.fits[1] Tue 17:22:44 22-Oct-2013<br><br># row WAVE FLUX ERR SKYBACK<br># angstrom erg cm**(-2) s**(-1) angstrom**(-1) erg cm**(-2) s**(-1) angstrom**(-1) erg cm**(-2) s**(-1) angstrom**(-1)<br><br> 1 3648.393 2.265424E-17 8.562715E-18 6.328494E-16<br> 3653.916 3.985785E-17 8.668060E-18 6.341451E-16<br> 3659.438 2.100061E-17 8.322070E-18 6.107177E-16<br> 3664.961 3.735991E-17 8.230550E-18 5.808179E-16<br><br></p><h4>IRAF generation of a scalar FITS table</h4><p>It is also possible to use a combination of tdump, tprint, and tcreate to generate a normal table via an ascii file.</p><ul><li>Input file: a.fits (in the ESO Science Data Product standard format (each data arary in one cell))</li><li>Output file: table.fits (a FITS binary table where each cell contains a scalar)</li></ul><p>tcreate is used to generate the desired output file.</p><p>tcreate requires two input files that must be generated: the column definition file, and an ASCII file containing the data.</p><p>The column definition file can be created using tdump, while the ASCII file containing the data can be created using tprint.</p><p><br></p><p>cl> tables<br>tables> ttools<br>ttools> tdump a.fits[1] cdfile="a.cd" > dev$null # to create the column definition file: a.cd<br></p><p><br>The a.cd (column definition file) shows something similar to:</p><p><br></p><p>WAVE R[1015] % 15.7g angstrom </p><p>FLUX R[1015] % 15.7g "erg cm**(-2) s**(-1) angstrom**(-1)" </p><p>ERR R[1015] % 15.7g "erg cm**(-2) s**(-1) angstrom**(-1)"</p><p>SKYBACK R[1015] % 15.7g "erg cm**(-2) s**(-1) angstrom**(-1)"</p><p><br></p><p>The square brackets in the second column indicate the array nature of the cells. The a.cd file must be edited and the brackets removed, as in:<br></p><p><br></p><p>WAVE R % 15.7g angstrom </p><p>FLUX R % 15.7g "erg cm**(-2) s**(-1) angstrom**(-1)" </p><p>ERR R % 15.7g "erg cm**(-2) s**(-1) angstrom**(-1)"</p><p>SKYBACK R % 15.7g "erg cm**(-2) s**(-1) angstrom**(-1)"</p><p><br></p><p><br></p><p>The ASCII tabular data can be created using the tprint command, as already seen earlier, but with some extra parameters:<br></p><p><br></p><p>ttools> tprint a.fits[1] pwidth=200 orig_row=no showrow=no showhdr=no showunits=no > table.dat</p><p><br></p><p>And finally the command to generate the output FITS "scalar" binary table:</p><p><br></p><p>ttools> tcreate table.fits a.cd table.dat</p><p><br></p><p><br></p><h3><strong>Python</strong></h3><p>For python users, the lines below illustrate a simple script to read and display a binary table format file.</p><p>A more detailed script, able to recognise the main scientific arrays in a 1d spectrum (using UTYPEs), and also able to deal with spectra containing multiple flux and flux error arrays, is available: <a href="http://archive.eso.org/cms/eso-data/help/1dspectrum.py">1dspectrum.py</a> (version: 2017-08-07).<br></p><p><br></p><p>#!/usr/bin/python</p><p>import sys<br>from astropy.io import fits<br>import numpy as np<br><br></p><p>hdulist = fits.open( "your_1d_spectrum_here.fits" )<br><br># print column information<br>hdulist[1].columns<br><br># get to the data part (in extension 1)<br>scidata = hdulist[1].data<br><br>wave = scidata[0][0]<br>arr1 = scidata[0][1]<br>arr2 = scidata[0][2]<br># etc.<br># where arr1 will contain the data corresponding to the column named: hdulist[1].columns[1]<br># where arr2 will contain the data corresponding to the column named: hdulist[1].columns[2]<br># etc.<br><br># To plot using maptplotlib:<br><br>import matplotlib.pyplot as plt<br><br>plt.plot(wave, arr1)</p><p>plt.show()</p><p> </p><p><br></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2023-09-21:/communities/11/topics/219-how-to-find-data-that-is-not-on-the-archive-but-should-be/2023-09-21T13:10:59+00:002023-09-21T13:10:59+00:00How to find data that is not on the archive, but should be. [questions] [completed]<p>Hello.</p><p>I am searching for some data of symbiotic systems on LMC and there are papers on literature that used ESO to get their data, but It doesn't show here on archive, like the case of <a href="https://articles.adsabs.harvard.edu/pdf/1996A%26A...307..516M">https://articles.adsabs.harvard.edu/pdf/1996A%26A...307..516M</a>. In there, they observed a sample of SySt on 1993, but this data does not exist here </p><br/><br/> Archive Science Group replied:<br/><p>Dear Mateus, <br></p><p>Unfortunately these data are not available. Back then data from 3.6m (or 1.54m) was not ingested yet in the ESO Archive.</p><p>Sorry we cannot help you.</p>Mateushttps://esocommunity.userecho.com/users/96-mateus/topics/tag:esocommunity.userecho.com,2023-06-28:/communities/18/topics/214-harps-how-to-get-the-pipeline-generated-files-ccf-s1d-e2ds-bis-int-guide/2023-06-28T12:45:25+00:002023-06-28T12:45:25+00:00HARPS - How to get the pipeline generated files (CCF, s1d, e2ds, bis, INT_GUIDE) [questions] <p>The HARPS pipeline generates separate products for both HARPS fibres (labelled A and B), cross correlating the observed spectra with template stellar spectra for various spectral types.</p><p></p><p>The primary product is a rebinned, combined 1-D spectrum in FITS binary spectroscopic data format. It is accompanied by a TAR file, containing the products of the original pipeline processing, both FITS and non-FITS.</p><p>Their content can be identified from their filenames. The root file name is “HARPS.<date_obs>”, where <date_obs> is the start of the observation in the “restricted ISO8601” format. This root name is appended with:</p><p>• “_s1d_<fibre>.fits” for 1-D extracted full spectrum, wavelength calibrated, in the solar system barycentric frame (the primary file of the release is the fibre A s1d file converted to the binary table format);</p><p>• “_e2ds_<fiber>.fits” for 2-D extracted spectrum, one row per order;</p><p>• “_bis_<sptype>_<fiber>.fits” for bisector from the cross correlation computed with the <sptype> mask;</p><p>• “_ccf_<sptype>_<fiber>.fits” for cross correlation function matrix for mask for ;</p><p>• “_ccf_<sptype>_<fiber>.tbl” for cross correlation function summary table (ASCII) with extracted radial velocity per each order;</p><p>• “_INT_GUIDE.fits” for integrated guiding image from the guide camera, used to confirm the correct centering of the star on the fibre. The image is integrated over the whole length of the scientific exposure.</p><p>Where:</p><p>• <fiber> is either “A” or “B”; in science observations the A fibre is used for the object, while the B fibre is used for ThAr lamp, dark or sky exposure, depending on the observation setup.</p><p>• <sptype> is either one of “G2”, “K5” or “M2”, depending on which spectral mask was used in cross-correlation with the spectrum. The pipeline automatically selects one of the masks based on the object’s spectral type, as recorded in the “HIERARCH ESO DPR TYPE” keyword. The “G2” mask is used if the spectral type is G9 or earlier or no spectral type is recorded, the “K5” mask is used for all Kn spectral types, and the “M2” mask is used for spectral types of M0 or later.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2023-06-28:/communities/18/topics/212-how-can-i-get-the-ccf-file-edited/2023-06-28T09:12:29+00:002023-06-28T09:12:29+00:00How can I get the CCF file? - edited [feedback] [completed]<p>edited message -- I need the CCF file for radial velocity correction?</p><p></p><p></p><p>original message</p><p>How can I get the ccv file? </p><p>I need the ccv file for radial velocity correction?</p><p></p><br/><br/> Archive Science Group replied:<br/><p>Dear User,</p><p>thanks contacting us.</p><p>There are no CCV files for radial velocities measurements.</p><p>The closest files names are CCF files.</p><p></p><p>You can find this type of files for examples inside the Ancillary HarpsTar file (TAR file containing several types of files, both FITS and non-FITS.)</p><p></p><p>You can get an Ancillary files in this way: assuming that you have the ADP name of the file in which you are interested (example ADP.2014-09-16T11:06:15.853), you can go to the Science Portal, query for it, reach the dataset page information</p><p><a href="http://archive.eso.org/dataset/ADP.2014-09-16T11:06:15.853">http://archive.eso.org/dataset/ADP.2014-09-16T11:06:15.853</a></p><p>and from here click on the blue button "Dataset Download" that will open the page of the download, and hence you reach the Download portal, where you can click on</p><p>"Include ancillary data", and hence select the method for downloading the data that you prefer. Once you download the file, you can extract the ADP and the ancillary file from the archive you downloaded. The ancillary file will be in a tar file that you need to decompress.</p>Anonymoustag:esocommunity.userecho.com,2022-08-12:/communities/18/topics/207-how-can-a-locate-spatially-the-x-shooter-slit-using-the-information-presented-in-the-header-in-the/2022-08-12T11:11:01+00:002022-08-12T11:11:01+00:00How can a locate spatially the X-Shooter slit using the information presented in the header (in the "XS_SRE2" file)? [questions] [under review]<p>I'm trying to locate the slit from an observation available in the data archive ("XS_SRE2" file). I am trying to compare it with integral field spectroscopy data from another instrument (creating a pseudo-slit). For this, I need to locate the X-Shooter slit in the sky.</p><p><br></p><p>- Should I use the keywords "CRVARL2", "CDELT2" as offsets (along the slit) from sky coordinate ("RA", "DEC")? In this case, the Position Angle (PA) should be equal to: PA = - "HIERARCH ESO ADA POSANG" (note the negative sign)?</p><p><br></p><p>- The XS_SRE2 file has 99 rows (in the sky offset dimension). It seems that the first 33, and the last 33 ones could be discarded, since they appear to be an effect of the Nod&Shuffle technique. Is that that right? This is the reason why there seems to be a contamination (fake aborption) in some rows in the middle (34 -- 66 rows, mainly the extreme ones 34-37 and 63-66)? Also, if I want to the offset in the sky (along the slit) of the row 35 (e.g.), it would be: OFFSET(35) = "CRVARL2" + 34 * "CDELT2"? </p><p><br></p><p>- There is a way to convert the flux units from counts to physical units (e.g. erg/s/cm2/A)?</p><p><br></p><p>Thank you,<br> </p><p></p><br/><br/> Archive Science Group replied:<br/>Brunohttps://esocommunity.userecho.com/users/87-bruno/topics/tag:esocommunity.userecho.com,2022-03-02:/communities/18/topics/202-first-data-release-from-the-eso-vista-public-survey-sharks-southern-h-atlas-regions-in-ks-band/2022-03-02T10:04:52+00:002022-03-02T10:04:52+00:00First data release from the ESO VISTA Public Survey SHARKS - Southern H-ATLAS Regions in Ks-band [feedback] <p style="float: right; margin: 0px 0px 10px 10px;"><img src="/s/attachments/25809/18/1/f0842f53ddaed6625d1ac1082258748e.png" style="width: 495px;" width="495"></p><p>The Southern H-ATLAS Regions in Ks-band (SHARKS) is a deep K<sub>s</sub>-band imaging survey conducted with the wide-field VIRCAM imager at the VISTA telescope. The project was granted 1200 hours of observing time under the ESO programme 198.A-2006, PI H. Dannerbauer, as one of seven approved second cycle VISTA Public Surveys.</p><p>It covers ~300 deg<sup>2</sup>, including large parts of the South Galactic Plane (SGP), GAMA-12h (G12) and GAMA-15h (G15) fields from the H-ATLAS survey, the largest Herschel program. The survey has been designed to provide the best possible counterpart identification for ∼90% of the sources detected at 0 < z < 3 by H-ATLAS, ASKAP, SKA and LOFAR; to produce a sample of strong lenses for cosmography studies; to study the evolution of the most massive structures in the Universe.</p><p>SHARKS DR1 consists of calibrated images and single band source catalogues from observations taken between March 2017 and January 2019. It covers a sky area of about 20 deg<sup>2</sup>, divided in 10 mosaics of ~2 deg<sup>2</sup> each. The 10 mosaics are distributed as follows: four contiguous mosaics in the SGP-E region, and two unrelated mosaics each in the SGP-W, G15 and G12 fields. The mean depth reaches the expected Ks magnitude of ~22.7 (AB, 5sigma) with a mean seeing of ~1’’. The products are available via the <a href="https://archive.eso.org/scienceportal/home?data_release_date=*:2021-10-21&data_collection=SHARKS&publ_date=2022-01-31">ESO Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=txt&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%20where%20obs_collection%3D'SHARKS'%0Aand%20publication_date%20between%20'2022-01-31'%20and%20'2022-02-01'%20&">programmatically</a>. More information about the release is available in the related <a href="http://www.eso.org/rm/api/v1/public/releaseDescriptions/179">documentation</a>.</p><p>SHARKS DR1 has been produced in collaboration with the Instituto de Astrofísica de Canarias (<a href="https://www.iac.es/">IAC</a>) and the Wide-Field Astronomy Unit (<a href="https://www.roe.ac.uk/ifa/wfau/">WFAU</a>) at the Royal Observatory of Edinburgh.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2022-03-02:/communities/18/topics/204-second-data-release-from-the-vista-cycle-2-eso-public-survey-visions/2022-03-02T10:03:11+00:002022-03-02T10:03:11+00:00Second data release from the VISTA Cycle 2 ESO Public Survey VISIONS [feedback] <figure style="float: right; margin: 0px 0px 10px 10px;"><img src="/s/attachments/25809/18/1/105b4738aad12307f98b39b4af153ecf.png" style="width: 293px;" width="293"></figure><p><a href="https://visions.univie.ac.at/">VISIONS</a> (programme id 198.C-2009, PI J. Alves) <br></p><p>is a Near-Infrared ESO second cycle VISTA Public Survey which covers all major nearby star-forming regions accessible from the southern hemisphere. This imaging survey is designed to deliver deep high-sensitivity observations of areas with large amounts of extinction. It includes also control fields which sample the predominant stellar populations in largely extinction-free regions and multiple epochs imaging data over large areas surrounding the targeted star-forming regions to enable the computation of proper motions for sources inaccessible to Gaia.</p><p><br></p><p>This second data release (DR2) contains all the observations on the star-forming region Corona Australis. In total, 160 tiles covering about 43 deg<sup>2</sup> have been observed, for a total of 3360 files and 0.87 T, between April 2017 and October 2021. The image quality is excellent throughout the entire survey fields with most data featuring point source FWHMs better than 1 arcsec. Compared to 2MASS, the survey reaches up to 6 mag fainter sensitivity limits.</p><p>For each observed field, photometrically and astrometrically calibrated tiles and stacked pawprints, together with a corresponding source table are published and available via the <a href="https://archive.eso.org/scienceportal/home?data_collection=VISIONS&publ_date=2022-02-28">Archive Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=txt&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%20where%20obs_collection%3D'VISIONS'%20and%20publication_date%20between%20'2022-02-28'%20and%20'2022-03-01'&">programmatically</a>.</p><p><br></p><p>A detailed description of the released data is available in the related <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/190">documentation</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2022-03-02:/communities/18/topics/203-first-data-release-of-the-burst-alert-telescope-agn-legacy-survey-of-molecular-gas-fueling-in/2022-03-02T09:56:54+00:002022-03-02T09:56:54+00:00First data release of the Burst Alert Telescope AGN legacy survey of molecular gas fueling in powerful nearby AGN [feedback] <p>The<a href="https://www.apex-telescope.org"> APEX</a> telescope has obtained CO(2-1) spectra for a sample of 165 hard-X-Ray-selected AGN galaxies detected in observations by the Burst Alert Telescope (BAT) onboard Swift. These observations, taken under the ESO programme id 198.A-0708, PI M. Koss, allow a statistical comparison of AGN and non-AGN dominated</p><p> galaxies in the local Universe, for example from the <a href="https://archive.eso.org/cms/eso-archive-news/release-of-co-2-1-spectra-from-allsmog.html">ALLSMOG APEX survey</a>.</p><figure style="float: right; margin: 0px 0px 10px 10px;"><img src="/s/attachments/25809/18/1/9fecb59fb8a05071e5c048e349481de3.png" style="width: 304px;" width="304"></figure><p><br> As this programme mainly aimed at observing a statistical sample of <br>nearby AGN, many of the galaxies observed are well-known galaxies, and these Phase 3 data can provide a valuable total power measurement of the CO(2-1) emission which then can be combined with interferometric observations obtained with ALMA. </p><p>Additionally, the BASS (BAT AGN Spectroscopic Survey) sample includes a variety of other ESO data products including hundreds of spectra with VLT/Xshooter, VLT/MUSE, and VLT/FORS2 with more information at the BASS survey <a href="http://www.bass-survey.com">website</a>. </p><p><br></p><p>This BAT AGN release available via the <a href="https://archive.eso.org/scienceportal/home?data_release_date=*:2021-10-21&data_collection=198.A-0708&publ_date=2022-02-01">Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=txt&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%20where%20obs_collection%3D'198.A-0708'%20and%20publication_date%20between%20'2022-02-01'%20and%20'2022-02-02'&">programatically</a>, makes the combined CO(2-1) spectra publicly available so users can derive further spectroscopic parameters, and compare them with other lines in these objects. The spectra either have a peak S/N>5 or reach depths of 0.5-2 mK rms for non-detections. Further details can be found in the <a href="https://iopscience.iop.org/article/10.3847/1538-4365/abcbfe">data release paper</a> or in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/188">release description</a>.</p><p></p><p>Instructions on how to read or display data in the ESO/SDP<a href="https://www.eso.org/sci/observing/phase3/p3edpstd.pdf"> tabular data format</a> can be found in the 1D spectrum<a href="http://archive.eso.org/cms/eso-data/help/1dspectra.html"> data format help page</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2022-02-08:/knowledge-bases/26/articles/178-archive-science-portal-cut-out-service/2022-02-08T14:03:02+00:002022-02-08T14:03:02+00:00Archive Science Portal: Cut-out service [articles] <p style="text-align: justify;">To minimize the download data volume the <a href="http://archive.eso.org/scienceportal/">Archive Science Portal</a> allows clipping the original full-size datasets with respect to position or spectral range while maintaining the intrinsic data quality (i.e., without resampling or re-scaling). These cutouts are supported for all science and most ancillary data-types having suitable positional or spectral dimensions (note that the cutout service is currently <em>not available for ALMA data</em>).</p><p></p><p>There are two ways of specifying the cutout parameters (parameters in the web interface or uploading a file).</p><p></p><p><strong>A. Simple use case: "I want a 2’ x 2’ cutout of the image I have selected…"</strong></p><p>1. Enter the J2000 position in the target field (e.g. “149.729 2.237”);</p><p>2. Select the radius: 1 arcmin;<br></p><p></p><figure><img src="/s/attachments/25809/26/1/7b58e33738e80685518f49f21e317220.png" style="width: 419px;" width="419"></figure><p></p><p>3. Click "Download" which opens a new panel;</p><p>4. Click "Download datasets" which opens a new page ("Download Portal");</p><p></p><p><img src="/s/attachments/25809/26/1/3e06fef7aa92ed8cf2e8a46fec17e0ab.png" style="width: 340px;" width="340"></p><p></p><p>5. In the Download Portal, select "Cutout" instead of "Full-size data";</p><p></p><p><img src="/s/attachments/25809/26/1/fed9c3259d2672a95d45e3a9d32ab789.png" style="width: 342px;" width="342"></p><p><br><br></p><p>6. Use any of the download options, for instance “Download ZIP file” to get all the cutouts at once.</p><p></p><p style="text-align: justify;"><strong>B. More complex examples with cutout parameters for multiple targets</strong></p><figure style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><a href="https://archive.eso.org/scienceportal/"><img alt="ASP" src="/s/attachments/25809/11/1/246343815dd13819d927847fbae75075.png"></a></figure><p>Information on the cutout service can be obtained by clicking on the <em>blue scissors</em> on the right of the Target filed of the <a href="http://archive.eso.org/scienceportal/">Archive Science Portal</a> webpage. In summary, as entered in the graphical user interface, the search parameters, target position, search radius and, optionally, spectral range (using the Spectral Range panel on the left GUI), are taken into account to generate the corresponding cutouts immediately before downloading from the ESO archive. Instead of entering these parameters one by one you may upload a target list with different format options. In the following example we will provide a road-map on how to use a target list to obtain the cutouts of <a href="https://www.eso.org/sci/facilities/paranal/decommissioned/sinfoni.html">SINFONI</a> cubes from the <a href="https://esocommunity.userecho.com/en/communities/18/topics/152-first-data-release-of-the-sinfoni-survey-for-unveiling-the-physics-and-the-effect-of-radiative">SUPER survey</a> around the Hβ and [OIII] line complex for the following targets:<br></p><p></p><table style="width: 60%;"><tbody><tr><th>Target</th><th>RA</th> <th>Dec.</th><th>Redshift</th></tr><tr><td>X_N_81_44</td><td>02:17:30.95</td><td>-04:18:23.66</td><td>2.311</td></tr><tr><td>S82X1905</td><td>23:28:56.35</td><td>-00:30:11.74</td><td>2.263</td></tr></tbody></table><hr><p style="float: right; margin: 0px 0px 10px 10px; width: 200px; height: auto;"><a href="https://archive.eso.org/scienceportal/home?ins_id=SINFONI"><img alt="ASP" src="/s/attachments/25809/11/1/5d6c4a6bc4a86e8821ae7f1988038c32.png"></a></p><p style="text-align: justify;"><strong>1. Select instrument</strong></p><p style="text-align: justify;">On the left GUI of the <a href="http://archive.eso.org/scienceportal/">Archive Science Portal</a> webpage select the <em>Data Type</em> and the <em>Instrument</em> you are interested in. In this case:</p><p></p><pre><code>Data Type = CUBEInstrument = SINFONI</code></pre><hr><p style="text-align: justify;"><strong>2. Upload the target list</strong></p><p style="text-align: justify;">Create your target list and upload it in the upload target field of the <a href="http://archive.eso.org/scienceportal/">Archive Science Portal</a> webpage. The target list is a text file containing: targets name, targets location, radii (in degrees) used to select the targets and perform the cutout, and the wavelength ranges you are interested to use for the cutout (in nanometer). Note that the wavelength ranges refer to the reference frame of the data product, normally the frame of observations. Thus, for the considered example, the target list looks like this:</p><p></p><pre><code>TARGET,RAJ2000,DEJ2000,RADIUS,WAVELMIN,WAVELMAX<br>X_N_81_44,34.37896,-4.30657,0.0006,1589.,1678.<br>S82X1905,352.23479,-0.50326,0.0006,1566.,1636.</code></pre><p style="text-align: justify;">Successfully uploaded targets will appear in the bottom of the <a href="http://archive.eso.org/scienceportal/">Archive Science Portal</a> webpage:<br></p><p></p><p style="text-align: justify;"><img src="/s/attachments/25809/11/1/80e4f71718ab1d9d4d172b96a00153dc.png"></p><hr><p><strong>3. Download the cutout of the selected data</strong></p><p style="text-align: justify;">After clicking on “<em>Download all datasets of all targets</em>” in the download menu. You will be prompted to the download page from where you can select the “<em>Cutout</em>” option to download the cutout of the cubes:</p><p></p><p style="text-align: justify;"><img src="/s/attachments/25809/11/1/e007d9ad8a6619e10f75ac47f3f55bd9.png"></p><p></p><p style="text-align: justify;">Enjoy (the cutout of) your data!</p><hr><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-11-02:/communities/18/topics/199-vvvx-dr11-published-releasing-the-entire-ks-time-series/2021-11-02T07:43:50+00:002021-11-02T07:43:50+00:00VVVX DR1.1 published: releasing the entire Ks time series [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="VVVXDR1.1" src="/s/attachments/25809/18/1/7481ff3738a903060ebec69a45aa02ba.jpg"></p><p style="text-align: justify;">The VISTA Cycle 2 ESO Public Survey project -<a href="https://vvvsurvey.org/">VVV eXtended</a>- PI D. Minniti, P. Lucas, is carried out with VIRCAM on VISTA in the JHKs filters and covers a total of ~1540 deg<sup>2</sup> of the southern Galactic plane.</p><p></p><p style="text-align: justify;">The VVVX DR1.1 complements DR1 by mainly providing i) the missing Ks time series and ii) the source lists generated from the pawprints published in DR1, which were observed between July 2016 and March 2018. The released data total about 9 TB. Science products generated from observations in the time interval from April 2018 to October 2019 are accessible in the already published DR2 release.</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">The time series data were taken in 'THIN' conditions, thus data with photometric zero points within 0.25 mag of the seasonal average value are accepted. The rather relaxed requirement on the image quality (seeing < 2.0 arcsec) has proven useful to deliver photometry for the bright stars also, that otherwise are saturated in data acquired with better seeing conditions.</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">Data are available via the <a href="https://archive.eso.org/scienceportal/home?data_release_date=*:2021-10-21&data_collection=VVVX&publ_date=2021-10">Archive Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=txt&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%20where%20obs_collection%3D'VVVX'%0Aand%20publication_date%20%3E%20'2021-10-01'%20&">programmatically</a>.More information regarding the release content is available in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/187">documentation</a>.<br><br></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-11-02:/communities/18/topics/198-new-gaia-eso-radia-velocity-catalogue-released-dr41/2021-11-02T07:37:34+00:002021-11-02T07:37:34+00:00New Gaia-ESO radia velocity catalogue released (DR4.1) [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="GAIADR4.1" src="/s/attachments/25809/18/1/e346a6cfbb74c1445e6c4bfdfd46ee49.png"></p><p>Gaia-ESO is a Public Spectroscopic Survey carried out with GIRAFFE and UVES on the VLT between 2012 and 2018. The survey targeted more than 100,000 stars, with 115,000 actually observed by the end of the survey. These stars are selected across all major components of the Milky Way, from halo to star-forming regions, with the goal of providing a homogeneous overview of their kinematics and elemental abundance distributions.</p><p style="text-align: justify;">With DR4.1, the Gaia-ESO team publishes a catalogue of radial velocities of more than 110,000 stars, covering 97% of all the objects whose spectra were previously published in December 2020 (DR4). The catalogue releasing the parameters for all the observed stars and the remaining 1D stacked spectra for additional 600 unique targets will be published in the forthcoming DR5. The full description of the current published catalogue and of the pipeline used to determine radial velocities can be found in the detailed <a href="http://www.eso.org/rm/api/v1/public/releaseDescriptions/186" title="http://www.eso.org/rm/api/v1/public/releasedescriptions/186">release document</a>.</p><p style="text-align: justify;">The catalogue preview (histograms and metadata) can be found <a href="https://archive.eso.org/dataset/ADP.2021-10-20T14:59:06.277" title="https://archive.eso.org/dataset/adp.2021-10-20t14:59:06.277">here</a>. An example of a programmatic access query to the catalogue is available <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=200&q=SELECT%20*%20FROM%20GES_2021_VRAD%0A%0A&">here</a>. The catalogue can be queried also via the <a href="https://www.eso.org/qi/catalogQuery/index/385" title="https://www.eso.org/qi/catalogquery/index/385">Catalogue Facility</a>.<br><br></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-11-02:/communities/18/topics/197-second-data-release-from-the-vista-cycle-2-eso-public-survey-vvvx/2021-11-02T07:33:22+00:002021-11-02T07:33:22+00:00Second data release from the VISTA Cycle 2 ESO Public Survey VVVX [feedback] <p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="VVVXDR2" src="/s/attachments/25809/18/1/7ba1695ad6c064d2686a584296a963ff.png"></p><p>The VISTA Cycle 2 ESO Public Survey project -<a href="https://vvvsurvey.org/">VVV eXtended</a>- PI D. Minniti, P. Lucas, is carried out with VIRCAM on VISTA in the JHKs filters and covers a total of ~1540 deg<sup>2</sup> of the southern Galactic plane.</p><p></p><p style="text-align: justify;">This second data release contains observations taken between April 2018 and October 2019. They consist of both multi-filter JHKs observations and time series Ks data with photometric limit reaching typically Ks=17.5 AB mag.</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">The survey data in Ks that were taken prior to April 2018 remain to be released (VVVX DR1 contained data from the multi-colour JHKs OBs and J-only OBs). The VVVX team is currently working to releasing these data as soon as possible, in order to provide a continuous time series.</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">Data are available via the <a href="https://archive.eso.org/scienceportal/home?data_release_date=*:2021-09-16&data_collection=VVVX&publ_date=2021">ASP</a> and <a href="http://archive.eso.org/programmatic/#TAP?f=txt&m=20000&q=SELECT%20*%20FROM%20ivoa.ObsCore%20where%20obs_collection%3D'VVVX'%20and%20publication_date%20%3E%202021-07-01&">programmatically</a>: 10776 tile images plus their associated weight maps and single-band source catalogues. In addition, the release contains the 64716 pawprint images.</p><p style="text-align: justify;">More details can be found in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/181">release description</a>.<br><br></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-10-29:/communities/18/topics/196-polygon-search-on-dboraw/2021-10-29T13:20:54+00:002021-10-29T13:20:54+00:00Polygon search on dbo.raw [questions] [completed]<p>Hi,</p><p></p><p>When I perform an ADQL query on ivoa.ObsCore with a polygon search, I get the same results as with the graphical search tool (650 hits).</p><p></p><p>SELECT *<br>FROM ivoa.ObsCore<br>WHERE CONTAINS(POINT('J2000', s_ra, s_dec), POLYGON('J2000', 93.47786,-63.86,87.47072,-63.91703,88.3048,-62.10095,94.85457,-58.15919,97.7867,-61.61193))=1<br>AND instrument_name='GIRAFFE'</p><p></p><p>When I try to do the same query on dbo.raw or dbo.ssa, I obtain an error saying 'Latitude values must be between -90 and 90 degrees'.</p><p></p><p>SELECT *</p><p>FROM dbo.raw</p><p>WHERE CONTAINS(POINT('J2000', ra, dec), POLYGON('J2000', 93.47786,-63.86,87.47072,-63.91703,88.3048,-62.10095,94.85457,-58.15919,97.7867,-61.61193))=1</p><p>AND instrument='GIRAFFE'</p><p></p><p>Why is it happening? Is my second query fixable?</p><p></p><p>I used the graphical search tool to draw the polygon and know the RA, DEC couples defining it.</p><p>Thanks in advance</p><br/><br/> Mathieu VdS replied:<br/><p>This is very great. Thanks again to the archive team for the great support and the great tools!</p>Mathieu VdShttps://esocommunity.userecho.com/users/83-mathieu-vds/topics/tag:esocommunity.userecho.com,2021-10-20:/communities/11/topics/195-cutouts/2021-10-20T14:53:48+00:002021-10-20T14:53:48+00:00cutouts [questions] [started]<p>how can I download cutouts of a given size from the Science Portal? I have successfully uploaded a list of target, and they are shown in the bottom of the page. However, from the download page, I cannot select "cutout" as it is grey. </p><br/><br/> Archive Science Group replied:<br/><p>Dear user,</p><p></p><p>There are two different options to upload the list of targets: </p><p></p><ul><li>You can upload your list of targets here to ensure that the cutout option will be already pre-selected in the Download Portal when downloading the data. (option number one in screenshot)<br><br></li><li>If you upload your target list from the main window, the functionality is the same <strong>except for the need to select the cutout option in the Download Portal explicitly</strong>. Data volumes displayed in the download portal reflect the data reduction thanks to cutouts in an approximate fashion. </li></ul><p>You can get more information clicking on on the scissors as shown in the screenshot below (option number 2), and more extended explanation if you click on "see dedicated help topic" (option number 3) on the displayed window.</p><p></p><p>Once you are in the <strong>download portal</strong>, regardless of targetlist or single target, one reason for the problem you're describing comes as a result from any search of (1d) spectra by position (+radius) because there is nothing to cutout from the 1-d spectrum based on the given positional constraint. Therefore the cutout service is disabled (=greyed out).</p><p></p><p>I hope this answers your question.</p><p></p><p>Best regards,</p><p></p><p>Archive Science Group</p><p></p><p></p><p><img src="/s/attachments/25809/11/1/32e2fe8cdbc65d512c85511e0e5d6189.png"></p>Anonymoustag:esocommunity.userecho.com,2021-10-18:/communities/11/topics/194-retrieve-calibration-files-for-harps-programatically/2021-10-18T13:16:43+00:002021-10-18T13:16:43+00:00Retrieve calibration files for HARPS programatically [questions] [started]<p>Has anyone had any experience with accessing the ancillary files for a HARPS observation programatically?</p><p></p><p>I found a filename in the header of the science file under the key ASSON1, but this filename does not match the files that are downloaded manually from the data archive, and when unpacked are not the same.</p><p></p><p>I have found a series of tutorials related to calibration files but I haven't been able to get any to work. If someone has a script that they could share that would be really welcome, thanks!</p><br/><br/> Archive Science Group replied:<br/><p>Dear Andrew,<br>The information that you should use the datalink service to get to the ancillary files is provided in the programmatic overview page: <a href="http://archive.eso.org/cms/eso-data/programmatic-access.html">http://archive.eso.org/cms/eso-data/programmatic-access.html</a> but I fully agree that that is not enough. I will publish a script for that. <br>Thanks for pointing this out. In the meantime...<br><br>Here I provide you preliminary snippets of the code necessary to do that, with explanations.<br>As said, it is the datalink service that allows you to find all kinds of files related to the input one.The datalink response for a HARPS calibrated spectrum contains, among others, the ancillary file you want to download (the tar ball).<br>As an example, try:<br></p><pre>http://archive.eso.org/datalink/links?ID=ivo://eso.org/ID?ADP.2014-09-16T11:03:30.940</pre><p>The ancillary files can be identified by the "semantics" field which must be set to "#auxiliary".<br>In python:<br>import eso_programmatic.py as eso <br><br># The eso_programmatic.py <br># is published here: <a href="http://archive.eso.org/programmatic/HOWTO/jupyter/authentication_and_authorisation/eso_programmatic.py">http://archive.eso.org/programmatic/HOWTO/jupyter/authentication_and_authorisation/eso_programmatic.py</a><br><br># Let's get the access_url of 3 HARPS products:<br>query = """SELECT top 3 access_url from ivoa.ObsCore where obs_collection='HARPS'"""<br>res = tap.search(query)<br>print(res)<br></p><pre> access_url object -------------------------------------------------------------------------------------http://archive.eso.org/datalink/links?ID=ivo://eso.org/ID?ADP.2014-09-16T11:03:30.940http://archive.eso.org/datalink/links?ID=ivo://eso.org/ID?ADP.2014-09-16T11:03:30.947http://archive.eso.org/datalink/links?ID=ivo://eso.org/ID?ADP.2014-09-16T11:03:30.973</pre><p># Let's loop through those 3, and for each of them loop through its #auxiliary entries (the tar ball is the only #auxiliary for an HARPS product anyway): <br>for rec in (res):<br> datalink = vo.dal.adhoc.DatalinkResults.from_result_url(rec['access_url'], session=session)<br> ancillaries = datalink.bysemantics('#auxiliary')<br> for anc in ancillaries: # for each ancillary, get its access_url, and use it to download the file<br> # other useful info available: print(anc['eso_category'], anc['eso_origfile'], anc['content_length'], anc['access_url'])<br> status_code, filepath = eso.downloadURL(anc['access_url'], session=session)<br> if status_code == 200:<br> print("File {0} downloaded as {1}".format(anc['eso_origfile'], filepath))<br><br>The result is:<br></p><pre>File HARPS.2006-08-09T05:48:52.136_DRS_HARPS_3.5.tar downloaded as ./ADP.2014-09-16T11:08:02.037.tarFile HARPS.2006-01-30T08:42:04.135_DRS_HARPS_3.5.tar downloaded as ./ADP.2014-09-16T11:04:44.533.tarFile HARPS.2006-07-30T07:45:53.333_DRS_HARPS_3.5.tar downloaded as ./ADP.2014-09-16T11:04:48.567.tar</pre><p>If you prefer to download the tar ball with its original name, then add "filename=anc['eso_origfile']" as in:<br> status_code, filepath = eso.downloadURL(anc['access_url'], filename=anc['eso_origfile'], session=session)<br>and you'll obtain:</p><pre>File HARPS.2006-08-09T05:48:52.136_DRS_HARPS_3.5.tar downloaded as ./HARPS.2006-08-09T05:48:52.136_DRS_HARPS_3.5.tarFile HARPS.2006-01-30T08:42:04.135_DRS_HARPS_3.5.tar downloaded as ./HARPS.2006-01-30T08:42:04.135_DRS_HARPS_3.5.tarFile HARPS.2006-07-30T07:45:53.333_DRS_HARPS_3.5.tar downloaded as ./HARPS.2006-07-30T07:45:53.333_DRS_HARPS_3.5.tar</pre><p><br>Thanks a lot for reporting the absence of examples on this!</p><p></p><p>Alberto Micol</p><p>ESO Archive Science Group<br><a name="dp_message_6381_end"></a><br><br></p>Andrew Jollyhttps://esocommunity.userecho.com/users/82-andrew-jolly/topics/tag:esocommunity.userecho.com,2021-08-06:/communities/18/topics/191-third-release-of-the-pessto-multi-epoch-catalogue/2021-08-06T08:16:39+00:002021-08-06T08:16:39+00:00Third Release of the PESSTO Multi-Epoch Catalogue [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="PESSTO" src="/uploaded/file/25809/18/1/fac72b567757b5b07975a1d582b4ee84.png"></p><p style="text-align: justify;">A new version of the PESSTO Multi-Epoch Photometric Catalogue provides photometric lightcurve coverage for the <a href="http://www.eso.org/sci/observing/PublicSurveys/sciencePublicSurveys.html#SPS">Public European Southern Observatory Spectroscopic Survey of Transient Objects (PESSTO)</a> targets for which follow-up lightcurves have been completed.This catalogue complements and completes the DR4 release <a href="http://archive.eso.org/cms/eso-archive-news/New-spectra-images-and-transient-catalog-of-the-PESSTO-public-survey-DR4.html">announced in March 2021.</a></p><p style="text-align: justify;">Photometric lightcurves for a total of 95 objects are now provided, 65 more than in the previous release (the lightcurves of 2 previously released transients have been removed from the catalogue as they do not qualify as PESSTO key-science targets).</p><p style="text-align: justify;">This PESSTO public survey data release (DR4.1) is accompanied by a <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/182">comprehensive description of the lightcurve catalogue</a>.</p><p style="text-align: justify;">Data are available via the ESO <a href="https://www.eso.org/qi/catalogQuery/index/374">Catalogue Facility</a>, or <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=200&q=SELECT%20host_id%2C%20transient_id%2C%20transient_classification%2C%0A%20%20%20%20%20%20%20lc.G_AB_MAG%2C%20lc.G_AB_MAGERR%2C%0A%20%20%20%20%20%20%20lc.R_AB_MAG%2C%20lc.R_AB_MAGERR%2C%20%0A%20%20%20%20%20%20%20lc.I_AB_MAG%2C%20lc.I_AB_MAGERR%2C%0A%20%20%20%20%20%20%20lc.Z_AB_MAG%2C%20lc.Z_AB_MAGERR%2C%0A%20%20%20%20%20%20%20lc.J_VEGA_MAG%2C%20lc.J_VEGA_MAGERR%2C%0A%20%20%20%20%20%20%20lc.H_VEGA_MAG%2C%20lc.H_VEGA_MAGERR%2C%0A%20%20%20%20%20%20%20lc.KS_VEGA_MAG%2C%20lc.KS_VEGA_MAGERR%0AFROM%20safcat.PESSTO_TRAN_CAT_V3%20as%20master%0AJOIN%20safcat.PESSTO_MPHOT_V3%20as%20lc%20%20ON%20lc.SOURCE_ID%20%3D%20master.TRANSIENT_ID%0AWHERE%0Amaster.TRANSIENT_ID%20%3D%20'SN2018ec'%0A%0A--%20Search%20some%20magnitudes%20from%20the%20PESSTO%20catalogue%20of%20lightcurves%20(PESSTO_MPHOT_V3)%20%0A--%20for%20transient%20SN2018ec%20in%20a%20circle%20of%200.05%20deg%20(3%20arcmin)%20aroung%20galaxy%20'ESO%20154-10'%2C%20positioned%20at%20(41.2863%2C%20-55.7406).%0A%0A%0A&">programmatically</a><sup>(1)</sup>, or via the <a href="https://archive.eso.org/scienceportal/home?data_collection=PESSTO&dp_type=CATALOG&sort=-obs_date&s=P%2fDSS2%2fcolor&f=176.685206&fc=-1,-1&cs=J2000&av=true&ac=false&c=9,10,11,13,14,15,16,17,18,19&ta=RES&h=ADP.2021-07-21T13:37:58.487&dts=true&sdtm=%7b%22CATALOG%22%3atrue%7d&at=207.68844,-2.50142&sr=i">Science Portal</a>. Specifically, <a href="https://archive.eso.org/dataset/ADP.2021-07-21T13:37:58.487">the catalogue preview</a> gives instantaneous access to the histograms of all the catalogues columns. The programmatic link brings to a query example to find the lightcurve of SN2018ec, object shown in the image which also illustrates the serendipitous discovery of AT2018cux.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-08-06:/communities/18/topics/190-third-and-final-data-release-of-the-large-early-galaxy-census-lega-c-spectroscopic-public-survey/2021-08-06T08:13:30+00:002021-08-06T08:13:30+00:00Third and Final Data Release of the Large Early Galaxy Census (LEGA-C) Spectroscopic Public Survey Published [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="LEGA-C" src="/uploaded/file/25809/18/1/60795f7b8004fc6879447fe64dc3a015.png"></p><p>The third and final data release of the Large Early Galaxy Astrophysics Census (LEGA-C, ESO programmes 194.A-2005, 1100.A-0949) is now available. The LEGA-C public spectroscopic survey targets the 1.5 deg2 of the COSMOS field (RA=10hr, Dec=+2 deg) with the VLT VIMOS multi-object spectrograph from December 2014 to May 2018.</p><p></p><p style="text-align: justify;">This data release contains the science products for the full survey, doubling the sample size with respect to the second data release of 2018. It consists of 4081 spectra of 3741 unique galaxies in the redshift range 0.6 < z < 1.0, with typical continuum S/N ≃17, wavelength coverage 6000-9000 Angstrom and spectral resolution of R~3500. The science data products are fully reduced with a custom-built pipeline. In addition to the 1D spectra, the data release contains a catalog with spectroscopic redshifts, emission line fluxes, Lick/IDS indices, spatially integrated stellar and gas velocity RMSs (line widths). </p><p></p><p style="text-align: justify;">The catalogue also provides additional structural parameters measured from HST images and dynamical mass measurements. More information is available in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/185">release documentation</a>.</p><p style="text-align: justify;">All data are publicly accessible from the <a href="https://archive.eso.org/scienceportal/home?data_collection=LEGA-C">Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP">programmatically</a>. In addition, the catalog can be browsed via the <a href="https://www.eso.org/qi/catalogQuery/index/379">Catalogue Facility</a> or <a href="http://archive.eso.org/programmatic/#TAP">.</a></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-07-14:/knowledge-bases/30/articles/189-eso-archive-talks-at-eas2021-28-june-2-july-2021-leiden/2021-07-14T11:49:21+00:002021-07-14T11:49:21+00:00ESO Archive Talks at EAS2021 (28 June - 2 July 2021 @ Leiden) [articles] <p style="text-align: justify;">This year the ESO Archive Science Group has participated on the European week of Astronomy 2021, with contributed talks as part of the special lunch session <em><a href="https://eas.unige.ch/EAS2021/session.jsp?id=LS1">LS1 Getting the most out of ESO data: a hands-on session on the ESO Science Archive and data processing tools</a></em>, and of the special session<a href="https://eas.unige.ch/EAS2021/session.jsp?id=SS14"> SS14 - Legacy and stewardship of astronomical archives towards multi-instrument, multi-wavelength and multi-messenger science</a>. The presentations in pdf format are here:</p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="martinoppt" src="/s/attachments/25809/30/1/d7da78cd5c336f63c1349605b1fbe5c9.png"></p><p><a class="i_item_file file-icon-pdf" data-file="147" data-name="SS14_ESO_SAMartino.pdf" href="/uploaded/file/25809/30/1/9cef6ccf79aa159f99f3a5e29af74379.pdf" title="SS14_ESO_SAMartino.pdf"><strong>The ESO Science Archive</strong></a></p><p style="text-align: justify;">The Science Archive is a major contributor to ESO’s scientific output. In 2020 more than 35% of the refereed papers that made use of data from ESO’s Paranal Observatory contained archival data, in line with an upwards trend that has continued for several years. The archive user base has been expanding at a rate of 500+ new users a year. The success of the ESO Science Archive is fuelled by a combination of content, both in terms of raw and processed data, and of services that guide the users in exploring an enormous parameter space to find the data they need for their unique science cases. In this contribution, I will elaborate on both of these aspects, highlighting the lessons we have learned by operating and developing the archive. An outlook on things to come will also be presented.</p><p></p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="laurappt" src="/s/attachments/25809/30/1/b153039b3b1a5ec3261dd271964e979f.png"></p><p><a class="i_item_file file-icon-pdf" data-file="146" data-name="EAS2021_p3Laura.pdf" href="/uploaded/file/25809/30/1/14f0d79e00f0b3a3f05b8cd823e359dc.pdf" title="EAS2021_p3Laura.pdf"><strong>Ensuring legacy value of data products: Phase 3 - the ESO solution</strong></a></p><p style="text-align: justify;">Since 2011 the ESO Archive operates a process which consists of preparing, validating, ingesting and publishing science-ready products for the community, the process is called Phase3. The main achievement of Phase 3 is to have created, in collaboration with its users, an archive composed of products stored in a homogeneous, VO-compliant format, with uniformly characterised proprieties.These properties made it possible to build enhance functionalities for data dissemination, discovery and further exploitation of the data and easier to cope with increasing volume and complexity of the archive holdings.The aim of this presentation is to briefly illustrate the Phase 3 process, starting with covering the main concepts defined in the Science Data Products Standard, the data types supported together with foreseen future extensions. An overview of the robust audit process in place in order to guarantee the compliance to the Standard is then presented. It consists of two part an automatic verification and a validation performed by an ESO operator. Only after acceptance the products get published together with the related documentation.<em><a></a></em></p><p></p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="emappt" src="/s/attachments/25809/30/1/38bb501478d7c0351302a296ae7b51bf.png"></p><p><a class="i_item_file file-icon-pdf" data-file="148" data-name="EPF_ESOArchivemma.pdf" href="/uploaded/file/25809/30/1/5fc07c33f30bfed1a0552942d4061fdf.pdf" title="EAS2021_EmanueleFarina.pdf"><strong>The necessity of careful data stewardship for Time Domain Astronomy: the ESO Archive Goldmine</strong></a></p><p style="text-align: justify;">Astronomers are aware of the changing looking sky since the first reported supernova event in 185 A.D., almost 2000 years ago. Yet, it is only with the advent of CCDs and robotically controlled telescopes that the field of time domain astronomy has literally exploded. However, data on known and unknown transient events are still potentially “buried” into astronomy archives and their "mining" is only possible if a consistent and homogeneous data stewardship is achieved. In this presentation I will focus on how a wealth of information can be easily “dig” out from ESO Science Archive. Thanks to the full characterization of the data-set ingested in the ESO Archive, it is indeed possible to retrieve more than 20 years of spectra, images, and catalogue entries collected with different telescopes and instruments and gain new insights on events such: Gravitational waves, Supernovae, and/or Changing look AGNs. I will conclude with a glance on how the ESO Archive will deal with the new fiber fed spectroscopic facility of the Vista telescope: 4MOST. Providing ~2400 high quality spectra per pointing, this will be an instrument for follow up of transient objects detected with the Vera Rubin Telescope.<em><a></a></em></p><p></p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="Jorgeppt" src="/s/attachments/25809/30/1/c15ffd150bd1c47d2da8d761ec5ac463.png"></p><p><a class="i_item_file file-icon-pdf" href="https://zenodo.org/record/5060238#.YO7PDy0Rrq0" title="EAS_JRE.pdf"><strong>Implementing FAIR guiding principles in the ESO Science Data Archive</strong></a></p><p style="text-align: justify;">The ESO science data archive hosts a wealth of astronomical data acquired in more than two decades using a variety of different observational techniques provided by more than two dozens different instruments at multiple observatory sites. The collection of over three million calibrated datasets, covering an extensive range of observational parameters, is publicly available to the community through a set of different interfaces for human users or machine consumption. The influx of new data is subject to careful quality control and verification procedures to guarantee that all data share one consistent standard in terms of data quality characterisation and metadata content. In this presentation we illustrate the implemented data management procedures to guarantee the long-term legacy value of ESO science data with respect to the FAIR (Findable, Accessible, Interoperable, and Reusable)<a href="https://doi.org/10.1038/sdata.2016.18"> Guiding Principles for scientific data management and stewardship</a> advocated by Wilkinson et al.<em><a></a></em></p><p></p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="Jorgeppt" src="/s/attachments/25809/30/1/0c40207cb1776bfbc5f026f86585d60c.png"></p><p><a class="i_item_file file-icon-pdf" data-file="161" data-name="EAS_Alberto.pdf" href="/uploaded/file/25809/30/1/71d860753ec847b8e9db76c6e581ecdb.pdf" title="EAS_Alberto.pdf"><strong>Programmatic access: enhanced discoverability and accessibility of the ESO science data</strong></a></p><p style="text-align: justify;">The ESO science archive has developed in the last three years new powerful ways that allow the astronomical community to discover and access its content, both interactively and programmatically. The progress made in terms of usability of the archive is stunning (see for example the "Lunch Session LS1: Getting the most out of ESO data: hands-on session").This contribution focuses on and describes the main services and standards onto which the ESO programmatic access is implemented, and shows some examples of how they can interplay to provide a powerful interoperable data discovery and access layer.Science reduced data, scientific catalogues, raw data, calibration reference files, measurements and profiling of various atmospheric parameters of the La Silla Paranal observatory, and including the ALMA science data, are (almost) all exposed via the same standard interfaces. This is not just a technical achievement as the ability to query together datasets usually served by different interfaces increases the level of discoverability of the entire archive, and is therefore a way to maximize the scientific return of the observatory.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-07-13:/knowledge-bases/30/articles/144-eso-archive-talks-at-eas2020-29-june-3-july-2020-leiden/2021-07-13T14:33:20+00:002021-07-13T14:33:20+00:00ESO Archive Talks at EAS2020 (29 June - 3 July 2020 @ Leiden) [articles] <p style="text-align: justify;">During the European week of Astronomy 2020 the ESO Archive Science Group presented the new possibilities of the ESO archive in two contributed talks as part of the session <em>SS18a - Scientific use of the spectroscopic archive in the long-term future</em>. The videos of the two talks will be available online on the conference web-site until the end of July 2020 (search for Laura Mascetti and Emanuele Paolo Farina), but you will be able to find the presentations in pdf format here:</p><p></p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt=" lauramascetti" src="/s/attachments/25809/30/1/3da58f9a84ba01b99abe219503f04662.jpg"></p><p><a class="i_item_file file-icon-pdf" data-file="73" data-name="EAS2020_LauraMascetti.pdf" href="/uploaded/file/25809/30/1/637d01dd8a48e0210b60052960924881.pdf" title="EAS2020_LauraMascetti.pdf"><strong>Feeding the ESO archive via Phase 3: ensuring long term availability and legacy value of spectral products</strong></a></p><p></p><p style="text-align: justify;"><em>The ESO archive is a powerful scientific resource for the astronomical community. It stores more than forty years of raw data generated by all ESO instruments, as well as the corresponding science-ready products and catalogues. Spectroscopic products from surveys and instruments like MUSE, UVES, XSHOOTER, FLAMES/GIRAFFE, HARPS and FEROS are regularly ingested and published. All spectra are stored in an homogeneous, VO-compliant format defined in the Phase 3 standard and are released together with an extended documentation, their release description. The aim of this presentation is to show how an homogeneous and well characterized archive content allows to build enhance functionalities for data discovery and exploitation. I will conclude presenting how the ESO archive is coping with the relentlessly increase in volume and complexity of the archive holdings, focusing on the handling of data from the new multi-object spectrograph 4MOST.</em></p><p></p><p></p><p></p><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="emanuelepaolofarina" src="/s/attachments/25809/30/1/e594800502ab62256f94ed0bf8dee4f6.jpg"></p><p></p><p><a class="i_item_file file-icon-pdf" data-file="76" data-name="EAS2020_EmanuelePaoloFarina.pdf" href="/uploaded/file/25809/30/1/08945e0a30697802ccc020455904fce9.pdf" title="EAS2020_EmanuelePaoloFarina.pdf"><strong>Cross validating new surveys with 40 years ESO archival spectra</strong></a></p><p></p><p style="text-align: justify;">The ESO Archive currently contains half a million images, two millions spectra and more than ten thousands datacubes. This incredible dataset is publicly available for data mining for a variety of scientific purposes, ranging from the local Universe to the first object emerging from the cosmic dark ages.<br>As an example, by selecting a sub-sample of high quality spectra collected with both MUSE and XSHOOTER, I will show how combining information coming from different instruments can shed new light on the properties of well known objects such as spectro-photometric standard stars.<br>In the near future, this approach would be fundamental to cross-validate the tens of millions of spectra foreseen to be collected with the 4MOST instrument on the ESO/VISTA telescope<em><a></a></em></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-07-06:/communities/18/topics/188-third-data-release-from-the-matisseoca-eso-project-ambre-harps-catalogue/2021-07-06T14:52:39+00:002021-07-06T14:52:39+00:00Third Data Release from the MATISSE/OCA-ESO Project (AMBRE): HARPS catalogue [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="AMBREDR3" src="/s/attachments/25809/18/1/dcaf7414474e1a7f82f17e501c838163.png"></p><p style="text-align: justify;"></p><p style="text-align: justify;">The AMBRE collaboration between the Observatoire de la Côte d'Azur (OCA, Nice) and ESO has the goal to analyse the wealth of stellar spectroscopic data in the ESO science archive using the MATISSE parametrisation algorithm to derive stellar atmospheric parameters (Recio-Blanco et al., 2006, MNRAS 370, 141, Worley et al. 2012, A&A 542A, 48, de Laverny et al. 2012, A&A 544A, 126, De Pascale (2014, A&A...570A..68).</p><p style="text-align: justify;">This data release provides stellar radial velocity, effective temperature, surface gravity, mean metallicity and enrichment in alpha-elements for about 93116 stellar objects observed between October 2003 and October 2010 using HARPS (378 nm – 691 nm). More information can be found in the related <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/180">release documentation</a>.</p><p style="text-align: justify;">The catalog of stellar parameters is available via the dedicated <a href="https://www.eso.org/qi/catalogQuery/index/371">Catalog Query Interface</a> or <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=200&q=SELECT%20top%2010%20*%20from%0AAMBRE_HARPS_V1%0A%0A&">programmatically</a>.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-05-11:/communities/18/topics/185-second-data-release-from-the-matisseoca-eso-project-ambre/2021-05-11T15:18:50+00:002021-05-11T15:18:50+00:00Second Data Release from the MATISSE/OCA-ESO Project (AMBRE) [feedback] [completed]<p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="AMBRE-UVES" src="/s/attachments/25809/18/1/43ec55cfc48eaee43504098e8aa7824f.jpg"></p><p style="text-align: justify;">The AMBRE collaboration between the <a href="https://www.oca.eu">Observatoire de la Côte d'Azur</a> (OCA, Nice) and <a href="https://www.eso.org/">ESO</a> has the goal to analyse the wealth of stellar spectroscopic data in the ESO science archive using the MATISSE parametrisation algorithm to derive stellar atmospheric parameters (<a href="https://ui.adsabs.harvard.edu/abs/2006MNRAS.370..141R/abstract">Recio-Blanco et al., 2006</a>, <a href="https://ui.adsabs.harvard.edu/abs/2012A%26A...542A..48W/abstract">Worley et al. 2012</a>, <a href="https://ui.adsabs.harvard.edu/abs/2012A%26A...544A.126D/abstract">de Laverny et al. 2012</a>, <a href="https://ui.adsabs.harvard.edu/abs/2016A%26A...591A..81W/abstract">Worley et al. 2016</a>).</p><p style="text-align: justify;">This data release provides stellar radial velocity, effective temperature, surface gravity, mean metallicity and enrichment in alpha-elements for about 6600 stellar objects observed between March 2000 and November 2010 using the VLT/UVES spectrograph. 51897 stellar spectra were analysed in total, resulting in the complete parameter set for about 20%. More information can be found in the related <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/178">release documentation</a>.</p><p style="text-align: justify;">The catalog of stellar parameters is available via the dedicated <a href="https://www.eso.org/qi/catalogQuery/index/370">Catalog Query Interface</a> or <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=200&q=SELECT%20top%2010%20*%20from%0AAMBRE_UVES_V1%0A%0A&">programmatically</a>.</p><p></p><br/><br/> Archive Science Group changed status to Completed Archive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-05-11:/communities/20/topics/186-access-to-catalogues-example-4/2021-05-11T15:16:14+00:002021-05-11T15:16:14+00:00Access to Catalogues: Example #4 [feedbacks] <p><img src="/s/attachments/25809/20/1/ba9fddef1329ce69d38dd13eb0e2dc00.jpg"></p><p style="text-align: justify;">Catalogues ingested in the ESO archive via the <a href="https://www.eso.org/sci/observing/phase3.html">Phase 3 process</a> are accessible via the <a href="https://archive.eso.org/scienceportal/home?dp_type=CATALOG&sort=-obs_date">ESO Archive Science Portal</a>, or via the <a href="https://www.eso.org/qi/">Catalog Facility</a>, or <a href="http://archive.eso.org/programmatic/#TAP?e=1">programmatically</a> via the `<em>tap_cat</em>` service.</p><p></p><p>Information from different catalogues can be cross-matched and compared. For instance, in the Figure on the top we plot the distribution the physical properties (effective temperature and gravity) of stars derived from with high-resolution spectroscopic observations of stars by the <a href="http://archive.eso.org/scienceportal/home?data_collection=AMBRE">AMBRE</a> and <a href="http://archive.eso.org/scienceportal/home?data_collection=GAIAESO">GAIAESO</a> collections.</p><p></p><p>The walk-through to obtain this information is illustrated in <a href="https://github.com/EmAstro/ESOAsg/blob/master/doc/notebooks/HOWTO_compareCatalogues.ipynb">this notebook</a> (it requires the installation of the un-official <a href="https://esoasg.readthedocs.io/en/latest/index.html">ESOAsg</a> python package). </p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-05-07:/communities/18/topics/184-first-data-release-from-the-galacticnucleus-survey/2021-05-07T07:18:50+00:002021-05-07T07:18:50+00:00First data release from the GALACTICNUCLEUS survey [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="GALACTICNUCLEUS" src="/s/attachments/25809/18/1/6e90e01ffd189ab4f475427c8761eba9.png"></p><p style="text-align: justify;">The goal of <a href="https://doi.org/10.1051/0004-6361/201936263">GALACTICNUCLEUS survey</a> (ESO Large Programme 195.B-0283, PI Rainer Schödel) is to build a single-epoch high angular resolution (0.2”) source catalogue of the Galactic Center in the near infrared bands J,H,Ks. Data were acquired with <a href="http://eso.org/sci/facilities/paranal/instruments/hawki.html">HAWK-I</a> between June 2015 and June 2018. They covered seven regions spread over the nuclear stellar disk, the inner Galactic bulge and the transition region between them, for a total area covered of about 0.3deg<sup>2</sup>. The final catalogue includes accurate PSF photometry for 3.3x10<sup>6</sup> stars. The 5-sigma limiting AB magnitude for the different NIR bands are J~22mag, H~21mag and Ks~21mag. The released catalogue also provides absolute coordinates for all the sources.</p><p></p><p style="text-align: justify;">In addition to the source catalogue, this data release includes images and related error maps from which the catalogue was extracted.</p><p></p><p style="text-align: justify;">More information is available in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/175">release documentation</a>, data are downloadable via the <a href="https://archive.eso.org/scienceportal/home?data_collection=195.B-0283">ESO Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=txt&m=200&q=SELECT%20*%20from%20ivoa.ObsCore%20%0AWHERE%20obs_collection%3D'195.B-0283'&">programmatically</a>, the catalogue can be queried via the <a href="https://www.eso.org/qi/catalogQuery/index/369">Catalog Facility</a> or <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=200&q=SELECT%20%20*%20from%20GNS_catalogue_V1&">TAP</a>.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-04-29:/communities/18/topics/183-release-of-pipeline-processed-espresso-1d-spectra-products/2021-04-29T13:03:15+00:002021-04-29T13:03:15+00:00Release of pipeline processed ESPRESSO 1D spectra products [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="ESPRESSO" src="/s/attachments/25809/18/1/8035ee291ac698ff2307ec5eeac2cbb9.jpg"></p><p style="text-align: justify;">This data release provides access to reduced scientific data obtained with <a href="https://www.eso.org/sci/facilities/paranal/instruments/espresso.html">ESPRESSO</a>. This instrument is a highly-stabilised fibre-fed echelle spectrograph that can be fed with light from either a single or up to four Unit Telescopes simultaneously. It is installed at the incoherent combined Coudé facility of the VLT.</p><p></p><p style="text-align: justify;">Nearly 2000 spectra obtained in all instrumental modes (HR, UHR, and MR) from the start of operations until March 2020 are now published via the <a href="http://archive.eso.org/cms.html">ESO archive</a>. The data consist of extracted, wavelength-calibrated and flux-calibrated 1-dimensional spectra with merged echelle orders. If several exposures on the same target are executed within the same observing template, the extracted and flux-calibrated spectra of the single exposures are combined into a co-added spectrum with increased signal-to-noise ratio. The combined spectrum becomes the primary product, while the single spectra are made available as associated files. The reduced science spectra come with an associated set of ancillary information which are described in detail in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/176">release description</a>.</p><p></p><p style="text-align: justify;">The ESPRESSO data collection will grow with time. As new ESPRESSO data are acquired at the observatory, the reduced products will become available in monthly release cycles as soon as they are processed. The data products can be queried and downloaded using the ESO <a href="https://archive.eso.org/scienceportal/home?data_collection=ESPRESSO">Archive Science Portal</a> or the <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%20TOP%2010%20*%20FROM%20ivoa.ObsCore%0AWHERE%20obs_collection%20%3D%20'ESPRESSO'">programmatic access</a>. More details about the data can be found in the published <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/176">data release description</a>. The 1D spectra are stored in a tabular format following the established standard for <a href="http://www.eso.org/sci/observing/phase3/p3sdpstd.pdf">ESO science data products</a>. Instructions on how to read or display the spectra can be found in the <a href="http://archive.eso.org/cms/eso-data/help/1dspectra.html">1D spectrum data format help page</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-04-26:/communities/18/topics/182-eso-science-archive-10000000-processed-science-files-downloaded-and-counting/2021-04-26T06:52:21+00:002021-04-26T06:52:21+00:00ESO Science Archive: 10,000,000 Processed Science Files Downloaded … and Counting! [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="ASP" src="/s/attachments/25809/18/1/3b13431c764feb35677ea97a4ac10f1a.png"></p><p style="text-align: justify;">March 17<sup>th</sup> marked an important milestone for the ESO Science Archive with the download of the 10,000,000<sup>th</sup> processed science file by a member of the ESO community. The Science Archive is a major science resource: more than 35% of the refereed papers based on ESO data that were published in 2020 used it. Its data holdings are constantly increasing, and it currently includes more than 3,000,000 processed datasets from the La Silla Paranal and ALMA observatories, calibrated to remove instrumental and atmospheric effects.</p><p style="text-align: justify;">These are spectra, images, data cubes, source catalogues, flux maps and interferometric visibilities (the 10,000,000<sup>th</sup> file itself was a spectrum from the <a href="http://archive.eso.org/dataset/ADP.2020-12-07T15:37:17.308">GAIA-ESO Public Survey</a>). These data products can be browsed and downloaded via an highly interactive and intuitive <a href="http://archive.eso.org/scienceportal/">web application</a> or <a href="http://archive.eso.org/programmatic/">programmatically</a> with Virtual Observatory protocols and tools.</p><p style="text-align: justify;">In addition to processed data, the ESO Science Archive also stores and serves all the La Silla Paranal raw data as generated at the telescopes and related calibrations. They too can be browsed via a <a href="http://archive.eso.org/scienceportal/">dedicated web interface</a> or <a href="http://archive.eso.org/programmatic/">programmatically</a>. Dedicated software processing tools to calibrate and extract the science signal <a href="https://eso.org/sci/software.html">are available</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-04-20:/communities/11/topics/181-absolute-flux-calibrated-spectra/2021-04-20T06:57:10+00:002021-04-20T06:57:10+00:00Absolute flux calibrated spectra [questions] [started]<p>Dear Helpdesk, <br></p><p></p><p>I would need to find flux callibrated spectra in absolute units but it is not clear to me how to query the archive by this condition. <br></p><p><br></p><p>Thank you very much in advance for your help. <br> </p><br/><br/> Archive Science Group replied:<br/><p style="text-align: justify;">Dear Enrique,</p><p></p><p style="text-align: justify;"> many thanks for using the ESO archive services.</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">There are different ways to achieve your goal:</p><p style="text-align: justify;"></p><ul><li>If you are interested in a specific data collection, for instance the <a href="http://xsl.u-strasbg.fr/">X-Shooter Spectral Library (XSL)</a>, you should refer to the associated <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/150">release description</a>, that contains information on how the data are reduced and the level of the calibration achieved.</li><li>It is possible to run a <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=5000&q=SELECT%20TOP%2010%20*%20FROM%20ivoa.ObsCore%20WHERE%20o_calib_status%20%3D%20'absolute'%20AND%20dataproduct_type%20%3D%20'spectrum'%0A&u=2&">TAP query</a> to obtain the list of all calibrated data by setting a WHERE condition on the <em>o_calib_status</em> column and requiring spectrum as <em>dataproduct_type</em>:<pre><code>SELECT TOP 10 * FROM ivoa.ObsCore WHERE o_calib_status = 'absolute' AND dataproduct_type = 'spectrum'</code></pre></li><li><p>If you are interested in a specific target, you can take advantage of the unofficial <a href="https://esoasg.readthedocs.io/en/latest/">ESOAsg</a> python package. For instance, if you want to collect all calibrated spectra present in the ESO archive associated with the star HD 057060, you can run:</p><pre><code>from ESOAsg import archive_observationsfrom astropy.coordinates import SkyCoord# Define star positionstar_position = SkyCoord.from_name('HD 057060')# Get information on all spectra collected within 5" from the stareso_spectra = archive_observations.query_from_radec(star_position, radius=5., columns=['dp_id', 'instrument_name', 'o_calib_status'], data_types='spectrum')# Select absolute flux calibrationcond_absolute = (eso_spectra['o_calib_status'] == 'absolute')# Download the dataarchive_observations.download(eso_spectra['dp_id'][cond_absolute])</code></pre>Note that this is equivalent to run this <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%0A%20%20%20%20%20%20%20%20target_name%2C%20dp_id%2C%20s_ra%2C%20s_dec%2C%20t_exptime%2C%20em_min%2C%20em_max%2C%0A%20%20%20%20%20%20%20%20dataproduct_type%2C%20instrument_name%2C%20obstech%2C%20abmaglim%2C%0A%20%20%20%20%20%20%20%20proposal_id%2C%20obs_collection%2C%20o_calib_status%0AFROM%0A%20%20%20%20%20%20%20%20ivoa.ObsCore%0AWHERE%0A%20%20%20%20%20%20%20%20INTERSECTS(CIRCLE('ICRS'%2C109.66824871%2C-24.55869773%2C5.%2F3600.)%2C%20s_region)%20%3D%201%20AND%0A%20%20%20%20%20%20%20%20dataproduct_type%20%3D%20'spectrum'%20AND%0A%20%20%20%20%20%20%20%20o_calib_status%20%3D%20'absolute'&">TAP query</a> and download the retrieved <em>dp_id</em>s<br></li></ul><p></p><p style="text-align: justify;">Please let us know if this answer your question. We can also provide a more tailored feedback, but we will need some more details on the goal you need to achieve.</p><p></p><p style="text-align: justify;">Enjoy your data!</p><p>The ESO Archive Science Group</p>Enrique Solanohttps://esocommunity.userecho.com/users/77-enrique-solano/topics/tag:esocommunity.userecho.com,2021-03-30:/communities/18/topics/180-new-spectra-images-and-transient-catalog-of-the-pessto-public-survey-dr4/2021-03-30T07:59:07+00:002021-03-30T07:59:07+00:00New spectra, images, and transient catalog of the PESSTO public survey (DR4) [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="PESSTO" src="/s/attachments/25809/18/1/53c7e8f3898841c598eccf0f72b44b35.jpg"></p><p style="text-align: justify;">A new release of the <a href="http://archive.eso.org/sci/observing/PublicSurveys/sciencePublicSurveys.html">Public ESO Spectroscopic Survey for Transient Objects (PESSTO)</a> is available, including spectra and images from its ePESSTO extension, and the delivery of a new transient catalogue, globally covering 7 years of observations, from April 2012 to April 2019, for a total of 45GB.</p><p></p><p style="text-align: justify;">This new release brings to 2323 the number of observed supernovae and optical transients, with calibrated 1D spectra for 2314 of them, doubling the number of objects previously published (1168 in the previous version). Also doubled is the number of selected key targets (now 337) that were scheduled for follow-up time-series EFOSC2 optical spectroscopy, so to monitor the supernovae at the extremes of the known population e.g. the most luminous, the faintest, the fast declining, etc. The total number of spectra for the key targets is 3748, including the SOFI spectra taken for the brightest ones. SOFI imaging (broad-band JHKs) was nearly always taken when SOFI near infra-red spectra were taken.</p><p></p><p style="text-align: justify;">Data are available via the ESO <a href="https://archive.eso.org/scienceportal/home?data_collection=PESSTO">Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=--%20Collection%3A%20PESSTO%0A--%20Showing%20the%20number%20of%20available%20products%2C%20and%20the%20number%20of%20unique%20targets%2C%0A--%20categorised%20by%20data%20product%20type%20(i.e.%2C%20image%2C%20spectrum%2C%20or%20measurements%20(read%3A%20catalogues))%0A%0ASELECT%20obs_collection%2C%20%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20dataproduct_type%2C%20%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20count(*)%20as%20num_products%2C%20%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20count(distinct%20target_name)%20as%20num_distinct_targets%20%0AFROM%20ivoa.ObsCore%0AWHERE%20obs_collection%20%3D%20'PESSTO'%0AGROUP%20BY%20obs_collection%2C%20dataproduct_type&">programmatically</a>. For more details on the observing strategy, the data reduction, calibration, and quality, along with a table of the selected key targets, and the description of the catalogue, please refer to the comprehensive <a href="http://www.eso.org/rm/api/v1/public/releaseDescriptions/174">release description</a>.</p><p></p><p style="text-align: justify;">Note: an updated version of the PESSTO multi-epoch photometry catalogue published in DR3.1 is expected by the summer.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-03-24:/knowledge-bases/30/articles/161-eso-archive-talk-at-the-2020-eiroforum-topical-workshop-on-big-data-26th-29th-october-2020-eso/2021-03-24T14:42:20+00:002021-03-24T14:42:20+00:00ESO Archive Talk at the 2020 EIROforum Topical Workshop on Big data (26th-29th October 2020 @ ESO) [articles] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><a href="https://indico.cern.ch/event/881752/"><img alt="BigData" src="/s/attachments/25809/30/1/e5477749f3e0415ac6d5530614004dd2.png"></a></p><p style="text-align: justify;">During the <a href="https://indico.cern.ch/event/881752/">2020 EIROforum Topical Workshop on Big data</a> the ESO Archive Science Group presented the new capabilities of the ESO archive in a contributed talk with title: <em>Mining the Southern Sky via the ESO Archive: Data-streams, cross matching, and forward look</em><em></em>. The slides of the presentation will be available online on the <a href="https://indico.cern.ch/event/881752/timetable/#all.detailed">conference web-site</a> (search for: Emanuele Paolo Farina), but you will be able to find the presentations in pdf format also here:</p><p></p><p></p><p style="text-align: justify;"><strong><a class="i_item_file file-icon-pdf" data-file="99" data-name="EPFarina_EIROForum2020.pdf" href="/uploaded/file/25809/30/1/42bd1e2bf296fe840f272746da2e7338.pdf" title="EPFarina_EIROForum2020.pdf">Mining the Southern Sky via the ESO Archive: Data-streams, cross matching, and forward look</a></strong></p><p></p><p style="text-align: justify;"><em>The ESO Science Archive currently contains (among others product) ~1,700,000 spectra, ~660,000 images, and ~280,000 cubes. Its goal is to preserve and make such multi-wavelength, multi-instrument, and multi-epoch wealth of information discoverable and accessible to any user of the scientific community. Such services are based on a consistent data standard (data format and meta-data content) and on photon provenance tracking. The scientific content of the archive can then be accessed through different interfaces, see for example the interactive interface of the <a href="http://archive.eso.org/scienceportal/home">ESO archive science portal</a>.</em></p><p></p><p style="text-align: justify;"><em>During the presentation I perform a ``virtual tour'' of the ESO archive, showing examples of data collections and cross utilization. I will also illustrate how the cross-matching of heterogeneous data-stream content (e.g. the ~60,000 recently reprocessed <a href="https://archive.eso.org/scienceportal/home?data_collection=UVES&sort=-obs_date">UVES spectra</a>, the ~90,000 newly delivered <a href="https://archive.eso.org/scienceportal/home?data_collection=KMOS&sort=-obs_date">datacubes from KMOS</a>, and infrared images from the <a href="https://archive.eso.org/scienceportal/home?data_collection=VHS&sort=-obs_date">Vista Hemisphere Survey</a>) allows users to validate their data and to open a new multi-band parameter space for discoveries. I will conclude with an outlook on the new challenge for the ESO archive: 4MOST. This new instrument will provide 20,000 new spectroscopic products each night (and related high level physical information), implying that in just one year will double the numbers of archive product collected to date.</em></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-03-24:/communities/18/topics/179-first-data-released-from-the-project-investigating-stellar-population-in-relics-inspire/2021-03-24T09:09:13+00:002021-03-24T09:09:13+00:00First data released from the project: 'Investigating stellar population in relics (INSPIRE)' [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="INSPIRE" src="/s/attachments/25809/18/1/e14f5a3f765f859909834df84efa6288.png"></p><p style="text-align: justify;">The INSPIRE project is an ESO Large Programme (ID: 1104.B- 0370, PI: C. Spiniello) which uses <a href="https://www.eso.org/sci/facilities/paranal/instruments/xshooter.html">X-Shooter</a> (in UVB, VIS, NIR band) to spectroscopically follow up 52 red ultra Compact Massive Galaxies selected from the <a href="http://kids.strw.leidenuniv.nl/">KiDS</a> VST ESO Public Survey.</p><p></p><p style="text-align: justify;">The goals of INSPIRE (<a href="https://doi.org/10.1051/0004-6361/202038936">Spiniello et al. 2021a</a>, <a href="https://arxiv.org/abs/2103.12086">Spiniello et al. 2021b</a>) is to obtain the first catalogue of spectroscopically confirmed relics in the redshift range 0.1<<em>z</em><0.5, bridge the gap between the three local confirmed relics and the high-<em>z</em> red nuggets, use the final statistic on confirmed relics to put a stringent constraint on the predictions from simulations on the initial burst of star formation in galaxies.</p><p></p><p style="text-align: justify;">This first release provides 76 1D spectra for 19 galaxies whose observations were completed. For each galaxy, there are four 1D spectra products: two UVB spectra and two VIS. For each object, the two pairs in each arm are extracted using either an aperture that includes 50% of the light or with an optimal extraction procedure on the entire slit. Together with the extracted 1D spectra, the combined UVB+VIS spectra, <em>restframed</em> and smoothed to a final resolution of FWHM = 2.52 Ang. are also published as ancillary files (these products were used for the stellar population analysis in S21b). The products contain measurements like redshift, stellar age and metallicity from the spectra in dedicated header keywords, which are listed in the detailed <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/173">release description</a> together with more details about the released products. The 1D spectra for the NIR arms and a comprehensive catalogue of the galaxies proprieties will be included in a future release.</p><p></p><p style="text-align: justify;">Data are available via the ESO <a href="https://archive.eso.org/scienceportal/home?data_collection=INSPIRE">Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%0AWHERE%20obs_collection%20%3D%20'INSPIRE'&">programmatically</a>.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-03-24:/communities/18/topics/152-first-data-release-of-the-sinfoni-survey-for-unveiling-the-physics-and-the-effect-of-radiative/2021-03-24T09:00:44+00:002021-03-24T09:00:44+00:00First Data Release of the SINFONI Survey for Unveiling the Physics and the Effect of Radiative feedback (SUPER) [feedback] <p style="text-align: justify;">The first data release of the SINFONI Survey for Unveiling the Physics and the Effect of Radiative feedback (SUPER, Circosta et al. 2018; ESO Large Programme 196.A-0377, PI: Mainieri) is now available to the community on ESO Archive via the Science Portal or <a href="http://archive.eso.org/programmatic/#TAP?f=application/x-votable+xml;serialization=TABLEDATA&m=200&q=SELECT%20*%20%20FROM%20ivoa.ObsCore%20where%20obs_collection%20%3D%20'SUPER'&">programmatically</a></p><p></p><p style="float: central; margin: 10px 10px 10px 10px; width: auto; height: auto;"><a href="http://www.super-survey.org/"><img alt="SUPER" src="/s/attachments/25809/18/1/11577cb578c00411923d64dbeff77ec0.png"></a></p><p></p><p style="text-align: justify;">This release consists of 20 SINFONI cubes targeting z=2-2.5 Type-1 AGNs in the H (or H+K) band. The adaptive optics module was employed during the IFU observations, abating the effects of atmospheric turbulence down to a superb angular resolution of 0.2 arcsecond (corresponding to ~2 kpc at the AGN redshifts). In combination with the long exposures (of the order of 1-7 hour), the data provides 3D spatially resolved high-quality maps of the Hβ and [OIII] emission lines and of the star emission from the AGN host galaxies.</p><p></p><p style="text-align: justify;">More information about the release content can be found in the <a href="http://www.eso.org/rm/api/v1/public/releaseDescriptions/159">accompanying documentation</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-03-18:/communities/18/topics/177-second-data-release-of-the-vista-extension-to-auxiliary-surveys-vexas/2021-03-18T14:33:08+00:002021-03-18T14:33:08+00:00Second data release of the VISTA EXtension to Auxiliary Surveys (VEXAS) [feedback] [completed]<p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><a href="https://indico.cern.ch/event/881752/"><img alt="VEXASDR2" src="/s/attachments/25809/18/1/738c8cce3c90198f25408c7a350529f0.png"></a></p><p style="text-align: justify;">The <a href="https://www.eso.org/sci/facilities/paranal/telescopes/vista.html">VISTA</a> EXtension to Auxiliary Surveys (VEXAS, <a href="https://ui.adsabs.harvard.edu/abs/2019A%26A...630A.146S/">Spiniello & Agnello, 2019</a>) project aims at building wide and spatially homogeneous multi-wavelength catalogues (from X-ray to radio) providing reference magnitudes, colors and morphological information for a large number of scientific uses. Currently the VEXAS catalogue is the widest and deepest public optical-to-IR photometric and spectroscopic database in the Southern Hemisphere, comprising more than 90 million objects with reliable photometry measured in at least one of the VISTA infrared bands, two of the WISE bands and three optical bands.</p><p></p><p style="text-align: justify;">This second release provides a new version of the three <a href="https://esocommunity.userecho.com/en/communities/18/topics/128-vexas-the-widest-and-deepest-public-optical-to-ir-photometric-and-spectroscopic-catalogues-covering">VEXAS DR1</a> optical+infrared tables: VEXAS-DESW, VEXAS-PSW and VEXAS-SMW in which sources fainter than 25 mag have been removed and additional quality improvements were applied. Objects are now classified into stars, galaxies and quasars using an ensemble of thirty-two different machine learning models, based on three different algorithms and on different magnitude sets, training samples and classification problems (two or three classes). A new version of the spectroscopic table is also </p><p style="text-align: justify;">provided. In order to build a training sample as large as possible and as complete and clean as possible in all the three classes of objects, on top of SDSS, 5 additional surveys have been used in this new version (SDSS DR16, <a href="https://ui.adsabs.harvard.edu/abs/2020ApJS..249....3A/abstract">Ahumada et al. 2019</a>; WiggleZ, <a href="https://ui.adsabs.harvard.edu/abs/2010MNRAS.401.1429D/abstract">Drinkwater et al. 2018</a>; GAMA DR3 <a href="https://ui.adsabs.harvard.edu/abs/2018MNRAS.474.3875B/abstract">Baldry et al. 2018</a>; OzDES, <a href="https://ui.adsabs.harvard.edu/abs/2017MNRAS.472..273C/abstract">Childress et al. 2017</a>; 2QZ, <a href="https://ui.adsabs.harvard.edu/abs/2004MNRAS.349.1397C/abstract">Croom et al. 2004</a>; and 6dFFS DR3, <a href="https://ui.adsabs.harvard.edu/abs/2009MNRAS.399..683J/abstract">Jones et al. 2009</a>) to which strict selection criteria have been applied. The machine learning pipeline and main results on the classification are described in detail in <a href="https://arxiv.org/abs/2103.09257">Khramtsov et al. (2021)</a>.</p><p></p><p></p><p style="text-align: justify;">Detailed information are available in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/172">release documentation</a>.The tables are linked to the primary one and can be queried together via the <a href="https://www.eso.org/qi/">ESO Catalogue Query Interface</a> or <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=200&q=SELECT%20schema_name%2C%20table_name%20FROM%20TAP_SCHEMA.tables%0AWHERE%20table_name%20like%20'VEXAS%25'&">programmatically</a>.</p><p></p><br/><br/> Archive Science Group replied:<br/><p style="float: right; margin: 10px 10px 10px 10px; width: auto; height: auto;"><a href="https://archive.eso.org/dataset/ADP.2020-02-10T10:15:28.571"><img alt="ASP" src="/s/attachments/25809/18/1/4e617e115c469e7be421b83d57a3aade.png"></a></p><p style="text-align: justify;"><br></p><p style="text-align: justify;">It is also possible to explore the catalogue via the <a href="https://archive.eso.org/scienceportal/home?data_release_date=2021-03-15:2021-03-19&data_collection=VEXAS">Archive Science Portal</a>. This interface allows users to visualize the distributions of different columns in a catalogue tile in a <a href="https://archive.eso.org/dataset/ADP.2020-02-10T10:15:28.571">comprehensive page</a>, by clicking on the action <em>Dataset details</em>. An example of this is shown in the image above.</p>Archive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-03-18:/communities/29/topics/176-telescope-night-log/2021-03-18T13:34:11+00:002021-03-18T13:34:11+00:00Telescope Night Log [questions] [searching answer]<p>Using the ESO archive, how can I generate a log of all activities that happen over a given night?</p><p></p><p>Thanks for your help!</p><br/><br/> Archive Science Group replied:<br/><p style="float: right; margin: 0px 0px 10px 10px; width: 500px; height: auto;"><a href="https://www.eso.org/gnlt/progress/index"><img alt="WEATHER" src="/s/attachments/25809/29/1/5f7d23fca22d4c05cf93306e2e29fb7f.png"></a></p><p style="text-align: justify;">Dear User,</p><p></p><p style="text-align: justify;"> Many thanks for using the ESO Archive Services.</p><p></p><p style="text-align: justify;">There are several ways to access the night logs depending on your specific needs.</p><p></p><p style="text-align: justify;">Details on a user's specific run can be collected via the <a href="https://www.eso.org/gnlt/progress/index">night log generator</a>. After logging-in in the ESO User Portal, you will be able to download (in PDF format) information on, e.g., weather conditions, daytime calibrations, and observations executed, associated with your observing run.</p><p></p><p style="text-align: justify;">Alternatively, it is possible to have an overview of all data collected during a night at a specific telescope by exploiting the <a href="http://archive.eso.org/cms/eso-data/programmatic-access.html">programmatic access to the archive science portal</a>. For instance, if you are interested data collected with <a href="https://www.hq.eso.org/public/teles-instr/paranal-observatory/vlt/vlt-names/antu/"><em>Antu</em></a> (i.e., <em>‘ESO-VLT-U1’</em>) during the night of the 15th of March 2021, you can run the <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=9999&q=SELECT%20*%20FROM%20dbo.raw%0AWHERE%20(date_obs%20LIKE%20'2021-03-15%25'%20OR%20date_obs%20LIKE%20%20'2021-03-16%25')%20AND%20telescope%20%3D%20'ESO-VLT-U1'&">following query:</a></p><p></p><pre><code>SELECT * FROM dbo.rawWHERE (date_obs LIKE '2021-03-15%' OR date_obs LIKE '2021-03-16%')AND telescope = 'ESO-VLT-U1'</code></pre><p style="text-align: justify;">Similarly, raw data collected during a specific night can be retrieved at the <a href="http://archive.eso.org/eso/eso_archive_main.html">Observational Raw Data Query Form</a>. From there, it is possible to access weather information associated to a given (science) observation both for <a href="https://www.eso.org/asm/ui/ambient-server?site=lasilla&mjd=59261.416729730000000&exptime=17.218&mark=EFOSC.2021-02-16T10:00:05.449&color=orange">La Silla</a> and for <a href="https://www.eso.org/asm/ui/ambient-server?site=paranal&mjd=59261.171346128000000&exptime=1199.999&mark=GIRAF.2021-02-16T04:06:44.306&color=orange">Paranal</a>.</p><p></p><p style="text-align: justify;">In case you are interested in having more information related to a specific night, you can always contact us, and we will be happy to provide a list of target observed (unless protected), observing conditions, etc.</p><p></p><p style="text-align: justify;">Please let us know if this answer your question. If not, we kindly ask you to provide more details on what you would like to achieve with this, so we will be able to provide a more tailored feedback.</p><p></p><p style="text-align: justify;">All the best,</p><p>the ESO Archive Science Group</p><p></p>jeisterhttps://esocommunity.userecho.com/users/76-jeister/topics/tag:esocommunity.userecho.com,2021-03-05:/communities/18/topics/175-new-version-of-the-eso-science-data-products-standard-v7/2021-03-05T13:49:29+00:002021-03-05T13:49:29+00:00New version of the ESO Science Data Products Standard (V7) [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 400px; height: auto;"><a href="https://www.eso.org/sci/observing/phase3/news.html#sdpstdv7"><img alt="SDPv7" src="/s/attachments/25809/18/1/d3e913e3b85b93bb3334b3dfbd383770.png"></a></p><p style="text-align: justify;">The version 7 of the <a href="https://www.eso.org/sci/observing/phase3/news.html#sdpstdv7">ESO Science Data Products Standard is now published</a>! This document is the reference for users on how to prepare their data for the submission through <a href="https://www.eso.org/sci/observing/phase3.html">Phase 3</a>. Highlights of the revision are:</p><p></p><p style="text-align: justify;"></p><ul><li>A new data format was introduced for single image products. It allows additional ways of packaging weightmap, background, etc in extensions and will support future science data products from future VLT NIR imagers , e.g., <a href="https://www.eso.org/sci/facilities/develop/instruments/eris.html">ERIS</a>.</li><li>White-light images associated with IFS cubes must now be identified with a unique product category.</li><li>In case of moving objects, more instructions are given on how to set up the source identifier.</li><li>Vector-valued fields are supported for catalogue data. There is a maximum limit of 1500 elements for these vectors.</li></ul><p></p><p style="text-align: justify;">For more detailed information, please consult the change record from the previous version, which is available in the document. The new version of the Science Data Products standard can be downloaded as <a href="https://www.eso.org/sci/observing/phase3/p3sdpstd.pdf">PDF document</a>. The <a href="https://www.eso.org/sci/observing/phase3.html">Phase 3</a> validation rules are currently being aligned with the <a href="https://www.eso.org/sci/observing/phase3/p3sdpstd.pdf">SDP standard version 7</a>. A summary of the implemented checks is available <a href="https://www.eso.org/sci/observing/phase3/phase3_checks_summary.txt">here</a>.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-02-18:/knowledge-bases/30/articles/172-introduction-to-the-eso-archive-as-a-science-facility-29-jan-12-feb-2021-eso/2021-02-18T15:18:46+00:002021-02-18T15:18:46+00:00Introduction to the ESO archive as a science facility (29 Jan & 12 Feb 2021 @ ESO) [articles] <p style="float: right; margin: 0px 0px 10px 10px; width: 500px; height: auto;"><a href="http://archive.eso.org/scienceportal/home"><img alt="ArchiveSciencePortal" src="/s/attachments/25809/30/1/315eafe7cae1a44989465165a769a234.jpg"></a></p><p style="text-align: justify;">PIs and co-Is of ESO approved programmes are familiar with the ESO archive as the repository of the raw data products from their observing runs.</p><p></p><p style="text-align: justify;">Since 2011, the content of the ESO archive has evolved from being mostly a technical repository to a science facility. The ESO Science Archive is now the larger facility ever, hosting `science-ready' data that are waiting to be mined, assessed and used to address scientific questions by the community. This multi-wavelength, multi-instrument, and multi-epoch wealth of information is discoverable via different interfaces, see, for example, the novel <a href="http://archive.eso.org/scienceportal/">ESO archive science portal</a>. Such services are based on a consistent data standard (data format and meta-data content) and photon provenance tracking.</p><p></p><p style="text-align: justify;">At the beginning of 2021, the ESO Archive Science Group presented a brief summary of the Phase 3 process (after P1 and P2) that is a prerequisite for the ingestion of data in the archive, and illustrated examples on how to access the variety of science data and catalogues that are currently available. A particular focus has been given on the use of both the archive science portal and programmatic access to cross-match the content of heterogeneous data-streams and thus enable a multi-parameter space for discoveries.</p><p></p><p style="text-align: justify;">The slides of the presentations are available here:</p><ul><li><a class="i_item_file file-icon-pdf" data-file="111" data-name="ESOArchiveAsAScienceFacility_01_Intro_MagdaArnaboldi.pdf" href="https://esocommunity.userecho.com/uploaded/file/25809/30/1/3f25e408743ad3abc716c55459e60bc2.pdf" title="ESOArchiveAsAScienceFacility_01_Intro_MagdaArnaboldi.pdf"> Introduction to the ESO Archive</a> (Magda Arnaboldi)</li><li><a class="i_item_file file-icon-pdf" data-file="114" data-name="ESOArchiveAsAScienceFacility_02_DataAccess_JoergRetzlaff....pdf" href="/uploaded/file/25809/30/1/d038ac6aba0ae507674b7495137f1a71.pdf" title="ESOArchiveAsAScienceFacility_02_DataAccess_JoergRetzlaff.pdf"> Data Access: Archive Science Portal and Catalogue Interface</a> (Joerg Retzlaff)</li><li><a class="i_item_file file-icon-pdf" data-file="112" data-name="ESOArchiveAsAScienceFacility_03_DataAccess_EmanuelePaoloFarina.pdf" href="/uploaded/file/25809/30/1/d164060523643cde65df48a3c90d0d35.pdf" title="ESOArchiveAsAScienceFacility_03_DataAccess_EmanuelePaoloFarina.pdf"> Data Access: Catalogue Interface and Programmatic Access</a> (Emanuele Paolo Farina)</li><li><a class="i_item_file file-icon-pdf" data-file="113" data-name="ESOArchiveAsAScienceFacility_04_Phase3_NausicaaDelmotte....pdf" href="/uploaded/file/25809/30/1/aca9364a8a30cdd85b731c557fe6caef.pdf" title="ESOArchiveAsAScienceFacility_04_Phase3_NausicaaDelmotte.pdf"> Phase 3: Intro</a> (Nausicaa Delmotte)</li><li><a class="i_item_file file-icon-pdf" data-file="118" data-name="ESOArchiveAsAScienceFacility_05_Phase3_LauraMascetti.pdf" href="/uploaded/file/25809/30/1/e584b4c1a3fbd4e7b20c022b786d9b05.pdf" title="ESOArchiveAsAScienceFacility_05_Phase3_LauraMascetti.pdf"> Phase 3: The Phase 3 process</a> (Laura Mascetti)</li><li> <a class="i_item_file" data-file="116" data-name="ESOArchiveAsAScienceFacility_06_Demo_EmanuelePaoloFarina.ipynb" href="/uploaded/file/25809/30/1/c0fbce4499e28419f5c470d8f99ac8d8.ipynb" title="ESOArchiveAsAScienceFacility_06_Demo_EmanuelePaoloFarina.ipynb"> Python Demo: Day 1</a> & <a data-file="117" data-name="ESOArchiveAsAScienceFacility_07_Demo_EmanuelePaoloFarina.ipynb" href="/uploaded/file/25809/30/1/15fa04229bac9baa68923e9204ace77f.ipynb" title="ESOArchiveAsAScienceFacility_07_Demo_EmanuelePaoloFarina.ipynb">Day 2</a> (Emanuele Paolo Farina; NOTE: these require the <a href="https://esoasg.readthedocs.io/en/latest/index.html">ESOAsg python package</a>)</li></ul><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-02-05:/communities/11/topics/137-metallicity-data/2021-02-05T07:40:17+00:002021-02-05T07:40:17+00:00Metallicity data [questions] [completed]<p>Hi,</p><p>first of all thank you very much for your awesome work. <br></p><p>I'm new to this data retrieval system and I feel kind of lost in front of it. I'm looking for metallicity data (in particular the [Fe/H] ratio) in the Milky Way bulge: how can I query the various databases for such data?</p><p></p><p>Thank you very much again!</p><br/><br/> Anonymous replied:<br/><p>Perfect! I was able to find the data I was looking for.</p><p>Thank you very much for your support.</p>Anonymoustag:esocommunity.userecho.com,2021-02-05:/communities/18/topics/170-fourth-and-final-data-release-of-the-spectroscopic-public-survey-vandels/2021-02-05T07:37:54+00:002021-02-05T07:37:54+00:00Fourth - and final - data release of the Spectroscopic Public Survey VANDELS [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><a href="https://archive.eso.org/scienceportal/home?data_collection=VANDELS"><img alt="VANDELS" src="/s/attachments/25809/18/1/631854c09fb3cdb58c4ca7b53a7c7561.png"></a></p><p style="text-align: justify;">The fourth and final data release of the deep <a href="http://www.eso.org/sci/facilities/paranal/decommissioned/vimos.html">VIMOS</a> survey of the CANDELS UDS and CDFS fields, <a href="http://vandels.inaf.it/">VANDELS</a>, is now available in the ESO Science Archive Facility.</p><p></p><p style="text-align: justify;">The <a href="http://vandels.inaf.it/">VANDELS</a> survey (Programme id 194.A-2003, PI L. Pentericci and R. McLure) started data acquisition in November 2014 and was completed in March 2018 before the VIMOS decommissioning. It delivers high signal-to-noise (range: 10-100), medium resolution (R~600) optical spectra (4800-10000Å) for galaxies in the UKIDSS Ultra Deep Survey (UDS) and Chandra Deep Field South (CDFS) survey fields. The total area covered is 0.2degree<sup>2</sup>.</p><p></p><p style="text-align: justify;">Using robust photometric redshift pre-selection, VANDELS targeted ≈2100 galaxies in the redshift interval 1.0<<em>z</em><7.0, with 85% of its targets selected to be at <em>z</em>≥3. VANDELS also targeted a substantial number of passive galaxies in the redshift interval 1.0<z<2.5. The magnitude range of the sample is H<sub>AB</sub><24mag for star-forming galaxies in the redshift interval 2.5<<em>z</em><5.5, H<sub>AB</sub><27mag for Lyman-break galaxies (LBGs) in the redshift interval 3.0<<em>z</em><7.0, and H<sub>AB</sub><22.5mag for passive galaxies at redshifts 1.5<<em>z</em><2.5.</p><p></p><p style="text-align: justify;">Each target received between a minimum of 20 hours and a maximum of 80 hours of on-source integration time. The legacy of VANDELS consists of determining the key physical properties of high redshift galaxies such as their stellar population ages, metallicities and outflow velocities from detailed absorption-line studies.</p><p></p><p style="text-align: justify;">This fourth data release consists of 2165 spectra (downloadable via the <a href="https://archive.eso.org/scienceportal/home?data_collection=VANDELS">ESO Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%20TOP%2010%20*%20FROM%20ivoa.ObsCore%0AWHERE%20obs_collection%20%3D%20'VANDELS'%0AAND%20publication_date%20BETWEEN%20%20'2021-02-03'%20and%20%20'2021-02-05'%20&">programmatically</a>), 1061 spectra in CDFS and 1104 in UDS field, respectively. DR4 totally replaces all products released in DR3 because of the new flux correction applied in the blue wavelength. In addition, DR4 provides 287 new spectra and 104 spectra of serendipitously observed objects.</p><p></p><p style="text-align: justify;">In addition to the 1D spectrum products, this final release contains also the catalogue with spectroscopic redshifts and the derived physical properties for each galaxy. The catalogue can be queried via the <a href="https://www.eso.org/qi/catalogQuery/index/351">Catalog Facility</a> or <a href="http://archive.eso.org/programmatic/?e=1&f=text&m=200&q=SELECT%20*%20from%20VANDELS_SPECTRO_V4&">TAP</a>.</p><p></p><p style="text-align: justify;">More information about the release content can be found in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/168">accompanying documentation</a> and in <a href="https://arxiv.org/abs/2101.07645v1">Garilli et al. (2021)</a>.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2021-02-03:/communities/18/topics/169-first-data-release-from-the-vst-survey-of-early-type-galaxies-vegas/2021-02-03T23:42:56+00:002021-02-03T23:42:56+00:00First Data Release from the VST survey of Early-type GAlaxieS (VEGAS) [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><a href="https://archive.eso.org/scienceportal/home?data_collection=VEGAS"><img alt="VEGAS" src="/s/attachments/25809/18/1/fd324e10af428bdff2a3b6235a7398a1.png"></a></p><p style="text-align: justify;">VEGAS is a deep multi-band (<em>u'g'r'i'</em>) imaging survey of bright (M<em><sub>B</sub></em><-21mag) early-type galaxies in the local volume within 54 Mpc/h carried out with <a href="https://www.eso.org/sci/facilities/paranal/instruments/omegacam.html">OmegaCam</a> on the VLT Survey Telescope (VST, <a href="https://ui.adsabs.harvard.edu/abs/2005Msngr.120...10C">Capaccioli et al., 2005</a>; see also the <a href="http://www.na.astro.it/vegas/VEGAS/Welcome.html">VEGAS website</a>). Observations are based on the VST Guaranteed Time Observation assigned to the Italian National Institute for Astrophysics under programme ID runs: 089.B-0607(A), 090.B-0414(B,D), 091.B-0614(A), 092.B-0623(B,C,D), 094.B-0496(D), 095.B-0779(A), 096.B-0582(B), 097.B-0806(A,B), 098.B-0208(A), 099.B-0560(A), and 0100.B-0168(A).</p><p></p><p style="text-align: justify;">This first date release publishes multi-band data for 10 fields, each of them covering a main galaxy and its close environment out to about 8-10 effective radii. The wide field of view, the long integration (ranging from 0.5 to 6.5 hours), and the high angular resolution of 0.21'' pixel<sup>-1</sup> delivered by VST allow the light distribution to be mapped down to a surface brightness level of ~29 mag arcsec<sup>-2</sup> in<em> g'</em>-band. These 23 science images (and corresponding weight maps) covering an area of ~42 deg² are now available to the ESO community via the <a href="https://archive.eso.org/scienceportal/home?data_collection=VEGAS&publ_date=2021-01-31:2021-02-02&sort=-obs_date">ESO Science Portal</a> and <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%20WHERE%20obs_collection%20%3D%20'VEGAS'%20AND%20publication_date%20BETWEEN%20%20'2021-01-31'%20and%20%20'2021-02-02'%20&">programmatically</a>. The total data volume is ~30Gb.</p><p></p><p style="text-align: justify;">More information about the release content can be found in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/167">accompanying documentation</a>.</p><p></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-12-29:/communities/29/topics/158-constellation-detection/2020-12-29T08:59:39+00:002020-12-29T08:59:39+00:00Constellation Detection [questions] [answered]<p>Hi,</p><p></p><p>I am currently making a constellation detection system for my school project, but I need to find a lot of unedited photographs of the night sky which has constellations fully in the image. Does anyone know where I could find any images like this? I'm having no luck myself.</p><p></p><p>Thanks in advance. :)</p><br/><br/> Archive Science Group replied:<br/>Thomashttps://esocommunity.userecho.com/users/69-thomas/topics/tag:esocommunity.userecho.com,2020-12-29:/communities/18/topics/168-high-resolution-muse-data-of-the-inner-region-of-ngc-7130-released/2020-12-29T08:58:38+00:002020-12-29T08:58:38+00:00High-Resolution MUSE data of the inner region of NGC 7130 released [feedback] <p style="text-align: justify;">The Seyfert starburst galaxy NGC 7130 was targeted for commissioning and science verification of the MUSE Narrow Field Mode, in programmes 60.A-9100(K) and 60.A-9493(A), P.I. Marja Seidel. The reduced data cube provides an angular resolution of 0.17 arcsec across a field of view of 7.5x7.5 arcsec<sup>2</sup> covering the spectral range between 4750 and 9300 Å with a resolution of about 2.5 to 2.7 Å. First, the data was processed using the standard ESO pipeline, then individual exposures were selected, manually aligned and combined into the final data cube for a total of 2100 seconds exposure time. This provides an equivalent white-light point source sensitivity of 22.4 mag AB (at 5 sigma). The data with its associated white light image is available from the <a href="http://archive.eso.org/scienceportal/home?data_collection=60.A-9493&publ_date=2020-12-10">ESO Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%20*%20FROM%20ivoa.ObsCore%20where%20obs_collection%20%3D%20'60.A-9493'&">programmatically</a>.</p><p></p><p style="text-align: justify;">Details on the observing programme and the data processing can be found in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/166">data release documentation</a> and in the associated publication Comerón et al. (2021, accepted in A&A, <a href="https://arxiv.org/abs/2011.02937">arXiv:2011.02937</a>).</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-12-29:/communities/18/topics/167-new-data-release-dr4-from-the-gaia-eso-spectroscopic-public-survey/2020-12-29T08:54:25+00:002020-12-29T08:54:25+00:00New data release (DR4) from the Gaia-ESO Spectroscopic Public Survey [feedback] <p style="text-align: justify;">The new data release from the Gaia-ESO Public Spectroscopic Survey (GES) <strong>DR4</strong> delivers about 190,000 stacked, quality-controlled, 1-d spectra (R between 18000 and 54000) of 114,500 unique stellar targets. These stars were observed with GIRAFFE and UVES from 31.12.2011 to 26.01.2018, during the entire time execution of the survey. These targets were selected from all the major structural components of the Milky Way: bulge, thick and thin discs, halo, including open star clusters of all ages and masses. The 1-D spectra from GES DR4 augment or update the spectra published in the previous data releases, which included observations up to July 2014 (~44000 spectra for ~25000 objects).</p><p></p><p style="text-align: justify;">A catalog of radial velocities is being finalized and will be released in the subsequent data release (DR4.1), together with the 1D stacked spectra for additional ~600 unique targets. The final data release from the Gaia-ESO survey containing the catalog with the measured stellar parameters will be released later in 2021.</p><p></p><p style="text-align: justify;">The total volume of GES DR4 is 32 GB. These data are available via the <a href="http://archive.eso.org/scienceportal/home?data_collection=GAIAESO&publ_date=2020-12-09">Science Portal</a>, and <a href="http://archive.eso.org/programmatic/#TAP?f=application/x-votable+xml;serialization=TABLEDATA&m=2000&q=SELECT%20*%20FROM%20ivoa.ObsCore%20%0AWHERE%20obs_collection%3D'GAIAESO'%20%0AAND%20publication_date%20between%20%20'2020-12-09'%20and%20%20'2020-12-10'&">programmatically</a>. More information is available in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/152">release documentation</a>. Instructions on how to read or display data in the ESO Science Data Products tabular data format can be found in the <a href="http://archive.eso.org/cms/eso-data/help/1dspectra.html">1D spectrum data format help page</a>.</p><p></p><p style="text-align: justify;">Related external resources: <a href="https://www.gaia-eso.eu/">Gaia-ESO home page</a></p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-12-29:/communities/18/topics/166-second-data-release-from-the-galaxy-clusters-at-vircam-gcav-eso-vista-public-survey/2020-12-29T08:49:30+00:002020-12-29T08:49:30+00:00Second Data Release from the Galaxy Clusters At Vircam (GCAV) ESO VISTA Public Survey [feedback] <p style="text-align: justify;">Galaxy Clusters At Vircam (<a href="https://sites.google.com/a/inaf.it/vista-gcav/home">GCAV</a>) is a survey (programme 198.A-2008, PI M. Nonino) belonging to the second cycle of ESO VISTA Public Surveys. It is aimed at observing 20 massive galaxy clusters covering in total ~30 deg<sup>2</sup> in the infrared Y, J, and Ks bands. Those clusters have also been observed in many ground- and space-based programmes (e.g. CLASH, RELICS, HFF/ BUFFALO). The survey will mainly explore galaxy evolution over a wide, and still largely unexplored, diversity of cluster environments.</p><p></p><p style="text-align: justify;">This second release adds new data of 15 galaxy clusters to the previous DR1. It contains tile images and related source lists from data collected over the time period from October 2016 to March 2020. The tile images reach a typical sensitivity in AB magnitude of ~23.5 in Y, ~23.4 in J, and ~22.4 in Ks. The total volume of the second data release is 1.3TB.</p><p></p><p style="text-align: justify;">All data are publicly accessible via the <a href="http://archive.eso.org/scienceportal/home?data_collection=GCAV&publ_date=2020-12-07">Science Portal</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=application/x-votable+xml;serialization=TABLEDATA&m=2000&q=SELECT%20*%20FROM%20ivoa.ObsCore%20%0A%20%20WHERE%20obs_collection%3D'GCAV'%20AND%20publication_date%20between%20%20'2020-12-07'%20and%20%20'2020-12-08'%0A&">programmatically</a>. More information is available in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/164">release documentation</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-12-09:/communities/12/topics/165-ngts-dr2-lightcurve-download/2020-12-09T09:01:14+00:002020-12-09T09:01:14+00:00NGTS DR2 lightcurve download [questions] [completed]<p>Hi,</p><p></p><p>I am trying to download the processed photometric lightcurve .fits files for the second NGTS data release. I'm very new to using the ESO's platforms, so although I've found the sky map downloading interface, and the light curve catalogue, I can't seem to find a way to simply download the entire ~4TB set of .fits files. Ideally there would be a place whereby one could click "request dataset" and a remote download link would be emailed but it's getting to that correct "request dataset" place that I'm struggling with.<br></p><p></p><p>I'd love any help on this matter and I realise this is probably a very basic question! <br></p><p></p><p>Thanks in advance!</p><p><br></p><br/><br/> Archive Science Group replied:<br/><p>Hi!</p><p>Correct, one other possibility is that after selecting your data via the Science Portal, you can chose the option of downloading the shell script, as shown in the image, which will download the data.<br></p><p>You just need to make the script executable (chmod u+x ) and run it from the command line. Note: the download script requires wget to be installed on your computer.</p><p>I hope this helps.</p><p></p><p><img src="/s/attachments/25809/12/1/d410870972bdeab43e583c02b3dfb952.jpg"></p>Space-Meerkathttps://esocommunity.userecho.com/users/73-space-meerkat/topics/tag:esocommunity.userecho.com,2020-11-12:/communities/18/topics/164-second-data-release-of-the-fornax-deep-survey-fds/2020-11-12T07:50:54+00:002020-11-12T07:50:54+00:00Second Data Release of the Fornax Deep Survey (FDS) [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><a href="https://archive.eso.org/scienceportal/home?data_collection=FDS"><img alt="FDS" src="/s/attachments/25809/18/1/3e31acb25eaf3ac6c70a806208efca93.png"></a></p><p style="text-align: justify;">The second data release from the <a href="https://esocommunity.userecho.com/communities/18/topics/151-first-data-release-of-the-fornax-deep-survey-fds">Fornax Deep Survey with VST</a> projects is now available on the ESO archive and it is accessible to the community via the <a href="https://archive.eso.org/scienceportal/home?data_collection=FDS&publ_date=2020-11-04">Science Portal</a>, <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=2000&q=SELECT%20*%20from%20FDS_SourceCatalogue_V1&">programmatically</a>, and via the <a href="https://www.eso.org/qi/catalogQuery/index/348">Catalogue Query Interface</a>. This data release follows the publication of the refereed paper by <a href="https://ui.adsabs.harvard.edu/abs/2020A%26A...639A.136C/abstract">Cantiello et al. (2020)</a>.</p><p></p><p style="text-align: justify;">This second release provides <em>ugri</em>-bands photometric and morphological parameters for 1.7 million sources over the ∼21 square degree area of the <a href="https://www.eso.org/public/images/?search=Fornax+Cluster">Fornax Cluster</a> centered on the bright central galaxy <a href="https://www.eso.org/public/images/?search=NGC+1399">NGC 1399</a>. Additionally, photometric and morphological parameters in the <em>gri</em>-bands are provided for 3.1 million sources located on a wider area of ∼27 square degrees which extends to the direction of the galaxy <a href="https://www.eso.org/public/images/?search=NGC+1316">NGC 1316</a>, also in the <a href="https://www.eso.org/public/images/?search=Fornax+Cluster">Fornax cluster</a>.</p><p></p><p style="text-align: justify;">The catalogues contain sources detected down to a 5-sigma magnitude limits which correspond to 24.1mag, 25.4mag, 24.9mag, 24.0mag in u-, g-, r-, and i-band, respectively (calculated for point sources). The total volume of the released catalogs is 1.2Gb.</p><p></p><p style="text-align: justify;">The second release also increments the previous image release with ~7.5Gb of images and weight maps for the FDS field n. 8 that have been processed and calibrated by the <a href="http://www.astro-wise.org/">AstroWISE</a>.</p><p></p><p style="text-align: justify;">More information about the release content can be found in the <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/162">accompanying documentation</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-10-28:/communities/18/topics/160-eso-complete-in-house-re-processing-of-20-years-of-uves-1d-spectra/2020-10-28T09:06:54+00:002020-10-28T09:06:54+00:00ESO complete in-house re-processing of 20 years of UVES 1D spectra [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 500px; height: auto;"><a href="http://archive.eso.org/dataset/ADP.2017-05-11T07:30:33.746"><img alt="UVES" src="/s/attachments/25809/18/1/2b7ef15d10212c1abf2381a4ffc47d01.jpg"></a></p><p style="text-align: justify;">As part of ESO’s efforts to offer science data products to its community via the ESO science archive facility, all the spectroscopic data acquired since the beginning of <a href="https://www.eso.org/sci/facilities/paranal/instruments/uves.html">UVES</a> operations at the VLT from March 2000 to March 2020, i.e. 20 years, have been reprocessed. Whenever possible, 1D spectra have been stacked at the OB level. The master calibrations associated with the science data before March 2015 have been reprocessed for better quality and consistency. Due to this reprocessing, some of the early science products not available before are now provided. All 1D spectra products are available from the ESO archive, have quality control plots and associated 2D extracted spectral images.</p><p></p><p style="text-align: justify;">The UVES stacked 1D spectra products are built from single exposure 1D spectra, whose scientific quality is similar to that of the UVES products, which were previously available in the data stream. These single exposure 1D spectra products are now served on request as ancillary files.</p><p></p><p style="text-align: justify;">The UVES reprocessed 1D spectra products can be discovered and downloaded via <a href="https://archive.eso.org/scienceportal/home?data_collection=UVES">ASP</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=application/x-votable+xml;serialization=TABLEDATA&m=2000&q=SELECT%20*%20FROM%20ivoa.ObsCore%20%0A%20%20WHERE%20obs_collection%3D'UVES'%0A&">programmatically</a>. More details are provided in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/163">documentation</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-10-12:/communities/20/topics/159-access-to-catalogues-example-3/2020-10-12T15:08:35+00:002020-10-12T15:08:35+00:00Access to Catalogues: Example #3 [feedbacks] <p style="float: right; margin: 0px 0px 10px 10px; width: 500px; height: auto;"><img alt="VISTA" src="/s/attachments/25809/20/1/2df7e4662f4da348e6d0339231798354.jpg"></p><p style="text-align: justify;">Catalogues produced by PIs of ESO observing programmes are integrated into the ESO science archive through the <a href="https://www.eso.org/sci/observing/phase3.html">Phase 3 process</a> and are accessible either via the <a href="https://archive.eso.org/scienceportal/home?dp_type=CATALOG&sort=-obs_date">ESO Archive Science Portal</a>, or via the <a href="https://www.eso.org/qi/">Catalog Facility</a>, or <a href="http://archive.eso.org/programmatic/#TAP?e=1">programmatically</a> via the `<em>tap_cat</em>` service.</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">An example of the large amount of information present in the archive is illustrated by the Figure on the right, where we show the distribution of the first 5,000,000 sources present catalogues that contain data from the <a href="https://www.eso.org/sci/facilities/paranal/telescopes/vista.html">ESO-VISTA telescope</a>. (The limit at 5,000,000 was set only for the sake of speeding up the data retrieval.)</p><p style="text-align: justify;"><br></p><p style="text-align: justify;">The walk-through to obtain this information is illustrated in <a href="https://github.com/EmAstro/ESOAsg/blob/master/doc/notebooks/HOWTO_getInfoFromCatalogueGivenTelescope.ipynb">this notebook</a> (it requires the installation of the un-official <a href="https://esoasg.readthedocs.io/en/latest/index.html">ESOAsg</a> python package). The full dataset is also accessible following this <a href="https://archive.eso.org/scienceportal/home?dp_type=CATALOG&ins_id=VIRCAM,OMEGACAM,%22OMEGACAM%2c%20VIRCAM%22&sort=-obs_date&">Archive Science Portal link</a> (where we we selected all catalogues obtained with VIRCAM and OMEGACAM data) or with the following <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=application/x-votable+xml;serialization=TABLEDATA&m=200&q=SELECT%0A%20%20%20%20cat_id%2C%20collection%2C%20table_name%2C%20title%2C%20number_rows%2C%20number_columns%2C%20version%2C%20acknowledgment%2C%20telescope%0AFROM%0A%20%20%20%20TAP_SCHEMA.tables%0AWHERE%0A%20%20%20%20schema_name%20%3D%20'safcat'%20AND%0A%20%20%20%20telescope%20LIKE%20'ESO-VISTA%25'%0A&">TAP query</a>:</p><pre><code>SELECT cat_id, collection, table_name, title, number_rows, number_columns, version, acknowledgment, telescopeFROM TAP_SCHEMA.tablesWHERE schema_name = 'safcat' AND telescope LIKE 'ESO-VISTA%'</code></pre><p style="text-align: justify;">More notebooks showing the power of the programmatic access are <a href="http://archive.eso.org/programmatic/HOWTO/">here</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/tag:esocommunity.userecho.com,2020-10-12:/communities/12/topics/134-muse-instrumental-profile/2020-10-12T12:11:13+00:002020-10-12T12:11:13+00:00MUSE instrumental profile [questions] [completed]<p>Hi,<br>We are using the reduced data from the archive to investigate outflows. I would like to check if the detected wings are not related with the instrument profile of the MUSE instrument. To do so, I would like to trace it in the sky emission lines. However, I do not know how access to the intermediate products of the archive reduced data. Please, could you kindly help me with this?<br>Many thanks in advance</p><br/><br/> Archive Science Group replied:<br/>Anonymoustag:esocommunity.userecho.com,2020-10-12:/communities/11/topics/123-searching-for-data-with-given-characteristics/2020-10-12T12:09:43+00:002020-10-12T12:09:43+00:00Searching for data with given characteristics [questions] [completed]<p>Hi, </p><p>this is the first time I use the Archive Science Portal...</p><p>I would like to select all the spectra observed so far with XSHOOTER, is this possible? And if instead I want to search only for data taken under my program (of which I am the PI)? Even more complicated...if I would like to check the seeing and weather conditions at the telescope when the data were taken? <br><br>Thanks a lot,</p><br/><br/> Archive Science Group replied:<br/><p>Dear user,</p><p>thanks for your question and for using our ASP... </p><p></p><p>Yes it is possible to select data taken with a given telescope, you will need to go on the top left corner on your screen and manage the query parameters, as I am showing in the following screenshot. <br></p><p><img src="/s/attachments/25809/11/1/3ffaca762694928dee33aa356c02afca.jpg"></p><p></p><p></p><p>When clicking on the button, a new menu will pop up: </p><p></p><p><img height="579" src="/s/attachments/25809/11/1/ca11fdf5a1d08a926eb5853ed0cf9420.jpg" style="width: 269.235px; height: 579px;" width="269.235"></p><p></p><p><br>As you can see, only the first six show up by default but from here you can select a series of other useful searching parameters. , including e.g., the instrument, the Data Collection, The PI, etc.etc.</p><p>These will then appear on the left side menu and you will be then able to choose what you wish (e.g. all the X-Shooter spectra or only these belonging to your program).</p><p><br>Concerning your second question, you can do that programmatically ;) </p><p>Have a look at this page: <a href="http://archive.eso.org/programmatic/#TAP">http://archive.eso.org/programmatic/#TAP</a> ... here we provide very useful example and demo on how to retrive weather information on a given date or select objects with specific characteristics (like e.g. seeing or FHWM). </p><p></p><p><br></p><p><br></p><p>I hope this helps!</p><p>Please do not hesitate to reply to this message if you need more clarifications.</p><p><br></p><p>Cheers,</p><p>Chiara, on behalf of ASG</p><p></p><p></p>Anonymoustag:esocommunity.userecho.com,2020-10-12:/communities/11/topics/142-how-can-i-search-for-data-from-specific-eso-programme-id-using-eso-science-portal-interface/2020-10-12T12:08:30+00:002020-10-12T12:08:30+00:00How can I search for data from specific ESO programme ID using ESO Science Portal interface? [questions] [completed]<p>I know that specific dataset has been generated from a given Programme ID. I see that Program Id is a selectable item, but the list of available options for X-SHOOTER is way too long to find the right one. Is there a way to type it somewhere in the interface?</p><br/><br/> Archive Science Group replied:<br/><p style="float: right; margin: 0px 0px 10px 10px; width: 300px; height: auto;"><img alt="Archive" src="/s/attachments/25809/11/1/e6519f8a90ad44a3e7b0ec156f62dda1.png"></p><p style="text-align: justify;">Dear user, <br> many thanks for using the Archive Science Portal! There are 3 ways to solve your problem:</p><ul><li>You can expand the Query Parameter column in the <a href="https://archive.eso.org/scienceportal/home?data_release_date=*:2020-06-26&ins_id=XSHOOTER&prog_id.keyword=60.A-9022&sort=-obs_date&s=P%2FDSS2%2Fcolor&f=177.115919&fc=-1,-1&cs=J2000&av=true&ac=false&c=21,8,9,10,11,12,14,15,18,19,20&ta=RES&dts=true&at=77.540841,-3.85292&sr=i">Archive Science Portal</a> (see figure on the right). From this you will be able to perform a more refined search for a given parameter. This is done by clicking on the little <em>show input form</em> arrow below each panel.</li><li>Alternatively, you can insert the <em>ProgId</em> you are interested in into the <a href="http://archive.eso.org/wdb/wdb/eso/xshooter/form">ESO XSHOOTER instrument specific query form</a>.</li><li>Finally, you can also run a <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=200&q=SELECT%0A%20%20%20%20target_name%2C%20dp_id%2C%20s_ra%2C%20s_dec%2C%20t_exptime%2C%20em_min%2C%20em_max%2C%20%0A%20%20%20%20dataproduct_type%2C%20instrument_name%2C%20obstech%2C%0A%20%20%20%20proposal_id%2C%20obs_collection%2C%20access_url%0AFROM%0A%20%20%20%20ivoa.ObsCore%0AWHERE%0A%20%20%20%20proposal_id%20LIKE%20'084.B-0869%25'%20AND%20instrument_name%3D'XSHOOTER'&">TAP query</a> where you select <code>instrument_name='XSHOOTER'</code> and your favourite <code>proposal_id</code>: <pre><code>SELECT target_name, dp_id, s_ra, s_dec, t_exptime, em_min, em_max, dataproduct_type, instrument_name, obstech, proposal_id, obs_collection, access_urlFROM ivoa.ObsCoreWHERE proposal_id LIKE '084.B-0869%' AND instrument_name='XSHOOTER'</code></pre></li></ul><p></p><p style="text-align: justify;">Please let us know if this answer your question! and enjoy your data!</p>Anonymoustag:esocommunity.userecho.com,2020-10-12:/communities/11/topics/148-extracting-reduced-data-of-m-dwarfs/2020-10-12T12:07:59+00:002020-10-12T12:07:59+00:00Extracting reduced data of M dwarfs [questions] [completed]<p style="text-align: justify;">Hi,</p><p></p><p style="text-align: justify;">I'm working on the X-Shooter library and M dwarfs. I'm trying to extract the reduced data of M dwarfs resolved by X-Shooter using a list of M dwarfs obtained from SIMBAD. The stars range from M0V-M9.5V. Is there an easy way of doing this programmatically? The list contains many stars that are not resolved by X-Shooter too so it will have to only extract the ones that are present in the ESO archive. I have been downloading the files manually from the website but it has an upper limit of 1000 items per list which has prevented me from using lists containing more than 1000 stars. I would also like to know if there is a way to go around this limit programmatically as well as on the website.</p><p></p><p style="text-align: justify;">Many thanks!<br> </p><br/><br/> Archive Science Group replied:<br/><p>Dear user,</p><p></p><p style="text-align: justify;"> many thanks for using the ESO archive system!</p><p></p><p style="text-align: justify;">To access to XSHOOTER data programmatically you can use a query similar to <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=20000&q=SELECT%0A%20%20%20%20target_name%2C%20dp_id%2C%20s_ra%2C%20s_dec%2C%20t_exptime%2C%20em_min%2C%20em_max%2C%20%0A%20%20%20%20dataproduct_type%2C%20instrument_name%2C%20obstech%2C%20abmaglim%2C%0A%20%20%20%20proposal_id%2C%20obs_collection%0AFROM%0A%20%20%20%20ivoa.ObsCore%0AWHERE%0A%20%20%20%20(INTERSECTS(CIRCLE('ICRS'%2C109.66824871%2C-24.55869773%2C5.%2F3600)%2C%20s_region)%3D1%20OR%0A%20%20%20%20%20INTERSECTS(CIRCLE('ICRS'%2C279.729582%2C6.27016%2C5.%2F3600)%2C%20s_region)%3D1%0A%20%20%20%20)%0AAND%0A%20%20%20%20instrument_name%20LIKE%20'XSHOO%25'%0A%0A&">this one</a>:</p><pre><code>SELECT target_name, dp_id, s_ra, s_dec, t_exptime, em_min, em_max, dataproduct_type, instrument_name, obstech, abmaglim, proposal_id, obs_collectionFROM ivoa.ObsCoreWHERE (INTERSECTS(CIRCLE('ICRS',109.66824871,-24.55869773,5./3600), s_region)=1 OR INTERSECTS(CIRCLE('ICRS',279.729582,6.27016,5./3600), s_region)=1 )AND instrument_name LIKE 'XSHOO%'</code></pre><p style="text-align: justify;">where you can include a list of INTERSECTS conditions connected with the OR logic (see <a href="http://archive.eso.org/programmatic/HOWTO/">these HOWTOs</a> for further details). With this, however, you will still hit a limit in the number of objects to be queried. This is due to the maximum length of the url that could be sent to the TAP service.</p><p></p><p></p><p style="text-align: justify;">It is not possible to overcome the 1000 object limit in the Archive Science Portal. If splitting your list in groups containing <1000 items each is not an option for you, an alternative can be found in <a href="https://esocommunity.userecho.com/communities/20/topics/143-access-to-spectroscopic-data-example-1">this forum page</a>. Here with provide a walk-through on<a href="https://github.com/EmAstro/ESOAsg/blob/master/doc/notebooks/HOWTO_getDataFromRaDec.ipynb">how to get data given a list of star names</a> with python. This requires the installation of the unofficial <a href="https://github.com/EmAstro/ESOAsg">ESOAsg</a> python package.</p><p></p><p></p><p>Enjoy your data!</p><p></p>Anonymoustag:esocommunity.userecho.com,2020-10-09:/communities/18/topics/157-new-band-merged-source-catalog-released-by-the-vvv-survey/2020-10-09T12:51:14+00:002020-10-09T12:51:14+00:00New band-merged source catalog released by the VVV survey [feedback] <p style="float: right; margin: 0px 0px 10px 10px; width: 500px; height: auto;"><a href="https://archive.eso.org/scienceportal/home?data_collection=VVV&publ_date=2020-10-09"><img alt="VVV" src="/s/attachments/25809/18/1/3e96e4e9eaedb28d2e0333bc06bac390.png"></a></p><p style="text-align: justify;">A new version of the <a href="https://vvvsurvey.org/">VVV VISTA Public Survey</a> source catalogue is now available from the ESO Archive. The imaging data in the <em>ZYJHKs</em> bands from which the source catalogue is extracted are acquired under ESO programme 179.B-2002 before the 26th of September 2015.</p><p></p><p style="text-align: justify;">The source catalogue covers the full area of the VVV survey on the Milky Way bulge and disk. It comprises 348 survey tiles for a total of 540 deg<sup>2</sup> where more than 590 million sources are detected. Compared to the previous published versions, this catalogue provides additional data, it includes two separate epochs of contemporaneous <em>JHKs</em> photometry and two separate epochs of contemporaneous <em>ZY</em> photometry.</p><p></p><p style="text-align: justify;">The VVV images utilized for the source extraction were processed with pipeline version v1.3 or grater by the Cambridge Astronomical Survey Unit (<a href="http://casu.ast.cam.ac.uk/">CASU</a>). These higher versions of the pipeline implement significant improvements to the data quality, such as improved photometric calibration procedures and more extensive Quality Control to identify bad data. Source catalogues were then created by the Wide Field Astronomy Unit (<a href="https://www.roe.ac.uk/ifa/wfau/">WFAU</a>) at the Royal Observatory, Edinburgh.</p><p></p><p style="text-align: justify;">The catalogue entries can be browsed via the <a href="https://www.eso.org/qi/catalogQuery/index/345"> Catalog Query Interface</a> or <a href="http://archive.eso.org/programmatic/#TAP?e=1&f=text&m=2000&q=SELECT%20*%20from%20VVV_bandMergedSourceCat_V3&">TAP</a>; the catalogue FITS files can be discovered and downloaded via <a href="https://archive.eso.org/scienceportal/home?data_collection=VVV&publ_date=2020-10-09">ASP</a> or <a href="http://archive.eso.org/programmatic/#TAP?f=text&m=2000&q=SELECT%20*%20FROM%20ivoa.ObsCore%20%0A%20%20WHERE%20obs_collection%3D'VVV'%0A%20%20AND%20publication_date%20BETWEEN%20'2020-10-09'%20AND%20'2020-10-10'%0A%20%20AND%20dataproduct_subtype%3D'catalogtile'&">programmatically</a>. More details are provided in the accompanying <a href="https://www.eso.org/rm/api/v1/public/releaseDescriptions/161">documentation</a>.</p><br/><br/>suggested by: Archive Science GroupArchive Science Grouphttps://esocommunity.userecho.com/users/1-archive-science-group/topics/