Initial situation
Work on facilitating access to and use of the INVEKOS data has so far been carried out mainly by Department II/1 of the BML. The current scope of the data offered is documented in the form of a description of the tables available in the respective year and their contents. Regular evaluations from the data pool are used, among other things, to prepare the BML's Green Report, to evaluate the Austrian Rural Development Program, to prepare the national agricultural accounts and to support research projects. A new query and evaluation system was developed and presented to the BML for the retrieval of anonymized individual farm accounting data. It is used to provide data for research purposes.
Objective
Numerous surveys and data evaluations are carried out by or on behalf of the BML, which regularly (annually, monthly, weekly) provide certain data sets. These include the agricultural structure surveys, surveys of acreage, stocks, producer prices, the agricultural accounts and foreign trade statistics of Statistics Austria, IN-VEKOS and subsidy data of the AMA, accounting data of the LBG, GIS data of Department II/4 of the BML or farm and land registers of the LFRZ. In addition, the BML has extensive databases on groundwater quality, biodiversity and forestry. There are links and connections between individual data sources that make it possible to carry out specific evaluations for a combination of data from several sources.
The aim of this project is to compile an overview of the various surveys and data sources and their content, to identify discrepancies between the data inventory and the data requirements and to establish compatibility between the available data inventories. All data available to the Federal Institute of Agriculture and Mountain Farmers' Questions (BAB) and the department are to be summarized and made quickly and easily accessible via interfaces, while fully safeguarding data protection and data security.
In addition, monthly and annual data on the development of issues and markets relevant to agriculture must be made available in an up-to-date form on the homepage of the Federal Institute of Agricultural Economics and Mining.
Work 2023
- Municipal database made publicly accessible
- Correction of the municipal structure in the data pool
- Inclusion of agricultural structure characteristics in the municipal database
- Data from the 2020 agricultural structure survey implemented
- Conversion of the advertising of bookkeeping companies from Access to PostgreS extended
- Development of a new interface with improved display (maps)
- Completion of all databases and datasets and creation of interfaces for the price portal preise.agrarforschung.at
- Takeover of all work (ongoing maintenance, expansion and further development) of the completed work package 1 (price portal) of the project BAB 059/22 Robust value and supply chains for agricultural goods and food in Austria - ROBVEK
- Development of a reporting system and automatic data transfer of auction data from the Central Working Group of Austrian Cattle Breeders (ZAR) to the ALFIS database
- Integration of forecast data into BAB-ALFIS
- Transfer of all evaluation profiles and data from ALFIS (LFRZ ceased operations in June) to BAB-ALFIS
- Reprogramming of the existing ALFIS scripts for the new BAB-ALFIS and expansion of the code for the creation of forecast data for IDB and test runs
- Development and migration of existing data pipelines to Apache Airflow
- Evaluations and automatic data transfer of auction data from the Central Working Group of Austrian Cattle Breeders (ZAR) to the ALFIS database. The annual territorial classifications created by the BAB (agricultural production areas, agricultural locations, alpine pasture regions) and the evaluations based on them are adapted to the new territorial status and the geodata are made publicly available in accordance with the INSPIRE Directive, including compliance with the additional requirements of the High Value Dataset Regulation. Various regional evaluations and maps are to be produced.
Work 2024
- Conversion and programming of the existing online tables of agricultural and economic data on the BAB website and the Green Report into the new "Tables online" web area
- Ongoing maintenance and further development of the price portal preise.agrarforschung.at; Ongoing maintenance and further development of the price portal preise.agrarforschung.at: The following work is being checked for feasibility and will also be partially implemented in 2024- Expansion to include additional products (auction prices, Wels stock exchange prices, market prices of fruit and vegetables, ...); Improvement of the web interface of the price portal (e.g. optimization for smartphones, individual compilation of data);Expansion of automated data transfer (web scraping, transfer of data via fee-based services); Installation of quality checks during data transfer; Creation of security groups for the maintenance of databases
- Ongoing improvements and error corrections in the newly programmed BAB-ALFIS
- Integration, conversion and updating of additional and existing data in BAB-ALFIS
- The description blocks (meta information) of the ALFIS features are revised and adapted to requirements
- Programming of a new tool for querying foreign trade data- Extension of predefined evaluation options and reports of data from the foreign trade database. This is useful as it allows users to carry out periodic evaluations quickly.
- Updating and further development of the municipal database (GeDaBa) and integration of new features
- Conception of an expansion of use of the PostGIS database
- Conception of further possible uses for georeferenced aerial images together with the LFRZ
- Intersection of agricultural data with GIS data- Networking in the geodata sector with related institutions as part of the BML's GIS-Jour-Fixe
- Programming of a new address database, which will then be kept evident by Dept. II/1
- Development of a project together with Dept. I/3 (protective water management) regarding flood data. In 2019, a test provision of the AOD for Dept. I/3 already took place. Since January 2020, the database has been replicated to the AOD in real time and enables internal evaluations by Dept. I/3. Operation will continue in 2024.
- Programming of a new address database, which will then be kept evident by Dept. II/1
- Development of a project together with Dept. I/3 (protective water management) regarding flood data. In 2019, a test provision of the AOD for Department I/3 already took place. Since January 2020, the database has been replicated to the AOD in real time and enables Department I/3 to carry out internal evaluations. Operation will continue in 2024.
- Development of a data exchange concept with the Central Hydrographic Office. The Callisto water level database has been in live operation at the BAB since June 1, 2021. It is being examined whether this data can also be implemented in the OpenDataCube. The water levels are interesting parameters for drought/precipitation monitoring.After examination and analysis, a separate project will be started for this point.
- Organization and technical implementation of the data transfer from the AMA from the beginning of 2023, after the AMA terminated all data flows and processing via the LFRZ and transferred them to the AMA's own system.In addition to these tasks for the AMA, the LFRZ also provided evaluation tools for exporting the data and automatically transferring it to ALFIS. The Market Transparency Regulation expands and newly regulates the data to be collected.The data requirements are also specified by the ROBVEK project.
- Further development of the data pool
- Node-based concept, load-balanced queries
- GPU acceleration, machine learning and deep learning integration using TensorFlow and PyTorch
- Integration of R_Studio into the JupyterHUB
- Create and further develop OLAP data cubes
- Implementing web-based data visualization and reporting
- Development or migration of existing data pipelines to Apache Airflow
- In 2024, the special evaluations for the area of compensatory allowance for disadvantaged areas (AZ) will also be continued and the results analyzed.
- The geodata of the territorial classifications (agricultural production areas, agricultural locations, mountain pasture regions) created annually by the BAB were adapted to the new territorial status. The geodata were harmonized for the first time in 202 in accordance with the INSPIRE Directive, hosted as data and view services (previously commissioned to the Federal Environment Agency) and made available via the national and European INSPIRE portal.
- Preparation of various regional evaluations and map representations
Further work 2024
- Collaboration in the REST-GDI-Agrar project of the Federal Environment Agency on behalf of the BML. The aim of the project is the creation of a geodata infrastructure (GDI) concept and its prototypical implementation for the digitalization of agriculture and the strengthening of rural areas. Specifically, the BAB is working on the technical implementation of a use case scenario application in this GDI prototype (probably implementation of the SatGrass model of the HBLFA Raumberg-Gumpenstein with access to satellite and climate data).
- At the request of Dept. II/6, a short evaluation (only related to the livestock and meat sector) will be created monthly in addition to the online offer.
- In 2024, the strategic orientation and further development of the data pool, which is subject to great dynamism in terms of its design and implementation due to ongoing technical innovations, will be further advanced and implemented.
- Continuation of the restructuring and consolidation of all data available in both the BAB and the BML.
