WELCOME TO THE
ESO ARCHIVE COMMUNITY FORUM
The ESO Archive Community Forum is a platform for sharing ideas and methods, asking questions and sending feedback and suggestions on how to improve and use the new ESO Archive Science Portal and on how to gain Programmatic and tool access to the archive science portal.
Contributions are welcome from the users, also without any need for registration, they are pre-approved, monitored and moderated by the ESO Archive Science Group (ASG).
If you wish to contribute to the knowledge exchange, please choose a Forum from the right panel or from the drop-down menu on the top of this page and write a message. An agent will receive it and make it public as soon as possible.
Please be aware that the official help concerning data access, data reduction and pipelines is provided by the ESO User Support Department.
Please observe the usual basic netiquette rule of remain professional, respectful, and courteous at all times.
The first data release of the Fornax Deep Survey with VST (FDS, Venhola et al., 2018, A&A, 620, 165) is now available on the ESO archive.
This consists of 97 high quality images (and of the corresponding weight maps) obtained by stacking u’, g’, r’, and i’-bands data collected with OmegaCAM on the VST from February 2013 to November 2017.
With exposure times ranging from 2 to 12 hours over an area of ~28 square degrees, this survey is a legacy data-set for studies of members of the Fornax Galaxy Cluster and the infalling Fornax A Group down to a surface brightness limit of ~28 mag/arcsec2 (1-sigma surface brightness over a 1 arcsecond2 area) and opens a new parameter regime to investigate the role of the cluster environment in shaping the properties of its galaxy population.
In these release, 181 Gb of (compressed) fits files reduced using the AstroWISE system are present. Catalogues with the complete sample of sources including dwarf galaxies part of the cluster, globular clusters, and background galaxies will be provided in forthcoming releases.
Archive users are informed that the in-house processed 1D spectra products for FEROS are now available for the months July, August, September, and October 2019. A total of 1432 new reduced 1D spectra have been added to the FEROS collection and are now downloadable from the archive science pages or programmatically.
These newly processed science products complement the set of the already available ~60,000 1D spectra for FEROS. This service is now resumed following the suspension in February 2020.
The Next Generation Transit Survey (NGTS) is a ground based exoplanet survey designed to detect Neptune and super-Earth sized planets orbiting around bright stars, using the transit method. The NGTS facility consists of 12 fully-robotic 20 cm f/2.8 telescopes located at the ESO site on Paranal, Chile. Each telescope has a 2.8x2.8 deg2 field of view and is equipped with a custom filter with a bandpass of 520-890nm, which increases sensitivity to late-K and early-M stars.
This second data release (DR2) includes 72 separate fields that have been completed from the start of commissioning in September 2015, till April 2018. The data of the 24 fields already provided within DR1 have been reprocessed with an improved version of the reduction pipeline. A source catalogue down to 16th magnitude is provided, together with the light curves obtained with aperture photometry in addition to the reduced, astrometrically calibrated, stacked dithered images. More than six hundred thousand sources were monitored with a 13 second cadence, collecting almost 110 billion photometric measurements in total. The overall data volume is about 4 Terabytes.
All data are publicly accessible from the Science Portal or programmatically in a file-by-file fashion. Per-source data access is provided by the Catalogue Facility or via TAP. Detailed information is available in the accompanying release documentation.
I'm working on the X-Shooter library and M dwarfs. I'm trying to extract the reduced data of M dwarfs resolved by X-Shooter using a list of M dwarfs obtained from SIMBAD. The stars range from M0V-M9.5V. Is there an easy way of doing this programmatically? The list contains many stars that are not resolved by X-Shooter too so it will have to only extract the ones that are present in the ESO archive. I have been downloading the files manually from the website but it has an upper limit of 1000 items per list which has prevented me from using lists containing more than 1000 stars. I would also like to know if there is a way to go around this limit programmatically as well as on the website.
many thanks for using the ESO archive system!
To access to XSHOOTER data programmatically you can use a query similar to this one:
SELECT target_name, dp_id, s_ra, s_dec, t_exptime, em_min, em_max, dataproduct_type, instrument_name, obstech, abmaglim, proposal_id, obs_collection FROM ivoa.ObsCore WHERE (INTERSECTS(CIRCLE('ICRS',109.66824871,-24.55869773,5./3600), s_region)=1 OR INTERSECTS(CIRCLE('ICRS',279.729582,6.27016,5./3600), s_region)=1 ) AND instrument_name LIKE 'XSHOO%'
where you can include a list of INTERSECTS conditions connected with the OR logic (see these HOWTOs for further details). With this, however, you will still hit a limit in the number of objects to be queried. This is due to the maximum length of the url that could be sent to the TAP service.
It is not possible to overcome the 1000 object limit in the Archive Science Portal. If splitting your list in groups containing <1000 items each is not an option for you, an alternative can be found in this forum page. Here with provide a walk-through on how to get data given a list of star names with python. This requires the installation of the unofficial ESOAsg python package.
Enjoy your data!
I know that specific dataset has been generated from a given Programme ID. I see that Program Id is a selectable item, but the list of available options for X-SHOOTER is way too long to find the right one. Is there a way to type it somewhere in the interface?
many thanks for using the Archive Science Portal! There are 3 ways to solve your problem:
- You can expand the Query Parameter column in the Archive Science Portal (see figure on the right). From this you will be able to perform a more refined search for a given parameter. This is done by clicking on the little show input form arrow below each panel.
- Alternatively, you can insert the ProgId you are interested in into the ESO XSHOOTER instrument specific query form.
- Finally, you can also run a TAP query where you select
instrument_name='XSHOOTER'and your favourite
SELECT target_name, dp_id, s_ra, s_dec, t_exptime, em_min, em_max, dataproduct_type, instrument_name, obstech, proposal_id, obs_collection, access_url FROM ivoa.ObsCore WHERE proposal_id LIKE '084.B-0869%' AND instrument_name='XSHOOTER'
Please let us know if this answer your question! and enjoy your data!
This data release provides 3D data cubes obtained from KMOS, the K-band Multi-Object Spectrograph.
The instrument is located at the VLT UT1 telescope and has 24 image slicer Integral Field Units (IFUs) that can be placed independently in the patrol field of 7.2 arcmin diameter. Each IFU has 14 slices with 14 spatial pixels along each slice and a field-of-view of 2.8’’x2.8’’ which gives a spatial resolution of 0.2’’. Spectral resolving power depends on the grating and is between 2000 and 4200. This initial release consists of observations from October 2013 (i.e. start of operations) until February 2020. The content of the release grows with time as new data are being acquired and processed.
Data have been reduced using the KMOS pipeline version 2.7.3 or higher. Data reduction is executed first for each IFU containing an object. It includes sky subtraction, flat fielding, wavelength calibration, flux calibration, and cube reconstruction. Telluric absorption features in the individual cube spectra are corrected. For this, an atmospheric model is fit to the closest-in-time telluric standard star measurement using the molecfit software. This model is scaled with the airmass difference between science observation and standard star measurement and applied to the extracted spectra. Flux calibration is applied using the zero-point measurement from the same standard star, without assessment of the photometric conditions. Note that all standard stars serve both as telluric and as photometric standards.
The KMOS data collection is current to March 2020, when observations were halted because of the Coronavirus-induced lock-down. It will grow again with time as observations will resume, with future processing on a roughly monthly cadence. More details about the KMOS data and their structure are available in the associated Phase 3 data release description.
The KMOS data cubes tagged "KMOS" can be queried and downloaded using the Phase 3 generic query form which provides access to all Phase 3 data, or the Phase 3 spectral data query form with query parameters suited to harvest 3D cube data. KMOS data can be browsed and accessed via the ASP web interface or programmatically.
During the European week of Astronomy 2020 the ESO Archive Science Group presented the new possibilities of the ESO archive in two contributed talks as part of the session SS18a - Scientific use of the spectroscopic archive in the long-term future. The videos of the two talks will be available online on the conference web-site until the end of July 2020 (search for Laura Mascetti and Emanuele Paolo Farina), but you will be able to find the presentations in pdf format here:
The ESO archive is a powerful scientific resource for the astronomical community. It stores more than forty years of raw data generated by all ESO instruments, as well as the corresponding science-ready products and catalogues. Spectroscopic products from surveys and instruments like MUSE, UVES, XSHOOTER, FLAMES/GIRAFFE, HARPS and FEROS are regularly ingested and published. All spectra are stored in an homogeneous, VO-compliant format defined in the Phase 3 standard and are released together with an extended documentation, their release description. The aim of this presentation is to show how an homogeneous and well characterized archive content allows to build enhance functionalities for data discovery and exploitation. I will conclude presenting how the ESO archive is coping with the relentlessly increase in volume and complexity of the archive holdings, focusing on the handling of data from the new multi-object spectrograph 4MOST.
The ESO Archive currently contains half a million images, two millions spectra and more than ten thousands datacubes. This incredible dataset is publicly available for data mining for a variety of scientific purposes, ranging from the local Universe to the first object emerging from the cosmic dark ages.
As an example, by selecting a sub-sample of high quality spectra collected with both MUSE and XSHOOTER, I will show how combining information coming from different instruments can shed new light on the properties of well known objects such as spectro-photometric standard stars.
In the near future, this approach would be fundamental to cross-validate the tens of millions of spectra foreseen to be collected with the 4MOST instrument on the ESO/VISTA telescope
The Vista Magellanic Cloud (VMC) Survey DR5.1 is now publicly available on the ESO Archive.
This incremental data release is based on observations acquired between February 2010 and October 2016 of 42 tiles encompassing the whole Small Magellanic Cloud (SMC), the Magellanic Bridge and the Magellanic Stream components of the survey. The total sky coverage is ~40 deg2 in the SMC, ~20 deg2 in the Bridge and ~3 deg2 in the Stream. This release adds reduced and calibrated deep products (co-added tile images and related single band catalogues), together with a multi-band (YJKs) aperture matched, epoch merged source catalogue for more than 14.6 million sources, three multi epoch single band catalogues, a catalogue of variable sources (39406 records) and a PSF photometry catalogue.
The new version of the ESO Science Data Products Standard is now published! This document is the reference for users on how to prepare their data for the submission through Phase 3.
A major effort has been devoted to improve the readability, consistency and clarity of the text and iIt now integrates the information published as separate addenda and in the Phase 3 FAQs.
The PDF version of the standard can be downloaded here.
first of all thank you very much for your awesome work.
I'm new to this data retrieval system and I feel kind of lost in front of it. I'm looking for metallicity data (in particular the [Fe/H] ratio) in the Milky Way bulge: how can I query the various databases for such data?
Thank you very much again!
many thanks for your question.
We suggest you to explore our catalogue facility: https://www.eso.org/qi/ where the content of all catalogues currently in the ESO archive is described. Reading your question, it seems that you may be interested in GAIAESO and AMBRE (but please check thoroughly that this is indeed the case and if there are other surveys that may cover your scientific interest).
To access the content of the catalogue and to download the corresponding data, we provide a variety of options. For instance for GAIAESO you can:
- query the Archive Science Portal for GAIAESO here;
- directly explore the different columns of the catalogue here;
- have access the data programmatically here;
- use the phase3 page dedicated to the collection here.
Please let us know if this satisfy your request and/or if you would like to have further assistance.
Best regards from the Archive Science Group!
Customer support service by UserEcho