je.st
news
Software Engineer
2019-03-05 17:32:25| Space-careers.com Jobs RSS
Gaia Data Release 3 as per current planning to appear in two stages in mid2020 EDR3 and 2nd half of 2021 DR3 will be substantially larger in data volume and much richer in content compared to previous public releases. DPACs CU8 will for the first time contribute, for a large number of stars, astrophysical parameters effective temperatures, surface gravities, stellar radii etc that have been computed from various data processing products of other CUs e.g. photometry from CU5, variability information from CU7. The validation of such data represents a formidable technical challenge in terms of hardware and database resources as well as needing specific expertise in data mining, data modelling, data querying and related topics all with an astrophysical and Gaiaspecific emphasis. The main objective of the requested service is to build and operate a data validation support platform which will allow CU8 scientists to carry out all needed validation activities in preparation for DR3. Once this key objective has been met the service is expected to shift towards supporting ongoing efforts within the Gaia SOC to provide stateoftheart data mining capabilities for DR3 endusers. In addition to what is specified in the Annex E to the Statement of Work see Business Area and Work Package above the following tasks and requirements are applicable Specific Tasks o Build and operate a data validation support platform for CU8 Formulating requirements for the envisaged validation platform in close interaction with CU8 and SOC personnel Defining the hardware and software environment needed to fulfil the requirements of the CU8 validation system Supporting the process of purchasing the needed resources for the platform Supporting the deployment of the validation platform Aiding CU8 in defining data models and data mapping rules Supporting CU8 scientists in all activities related to their usage of the provided platform Proactively advising CU8 scientists in optimizing validation strategies o Contribute to provision of stateoftheart data mining capabilities for DR3 endusers Find synergies within the data mining needs internal to CU8 and CU9 validation groups Develop, in close cooperation and under the authority of the CU9 data mining lead, the CU8 and CU9 internal services into a unified framework with frontend portal to provide data mining services ultimately to the endusers Requirements The service will require a high level of Experience working in an international environment Excellent communication skills notably in interfacing with different stakeholders with diverse backgrounds for example Scientists Knowledge and software engineering experience in, Python and Java. Knowledge of HTML5, CSS and Javascript, for development of the data mining frontend, is an asset Knowledge of and practical experience with managing relational database management systems serving TBscale datasets, specifically knowledge of PostgreSQL Knowledge of and, ideally experience with, stateoftheart data mining concepts and related technologies, including practical experience with Apache Spark Knowledge of Jupyter Notebook, Jupyter Lab and Jupyter Hub frameworks, their APIs and kernels Experience in working with large astronomical data sets
Tags: software
engineer
software engineer
engineer software
Category:Transportation and Logistics