LANDSCAPE OF OPEN DATA SETS AND PLATFORMS

Many organizations are making data publicly available for different uses and offering a variety of hosting and listing services. Although not an exhaustive list, the following table provides examples of organizations with open data platforms and specific data sets that are relevant to mining. This list aims to supplement the Guideline for Sharing Open Data Sets in Mining. The list is sorted alphabetically by organization.

This list is intended to be a live document and we encourage you to reach out with additions or corrections. Anything missing or that you would like to add to this list? Please contact us

Industry/Organization

Description

Related Links

4TU Research Data

Provides general research data in science, engineering, and design with mining categories

https://data.4tu.nl/

Australian Government

Provides geospatial data sets and other spatial indexes

https://data.gov.au/data/

Australian Research Data Commons (ARDC)

Provides Australian research communities and industries access to data intensive eInfrastructures, platforms, skills, and collections of data

https://ardc.edu.au

AWS S3 Data sets

Includes data sets provided and maintained by a variety of third parties under a variety of licenses, offers listing services

https://registry.opendata.aws/

BDD100K

A Diverse Driving Dataset for Heterogeneous Multitask Learning

https://www.bdd100k.com/

Canadian Government

Provides ability to search open data relevant to Canadians

https://open.canada.ca/en/open-data

Centre for Open Science

Provides Transparency and Openness Promotion (TOP) Guidelines, 2015, with more than 5000 signatories

TOP Guidelines: https://www.cos.io/top

Signatories: https://www.cos.io/top#tabid4

Centro Avanzado de Tecnología para la Minería (AMTC)

Provides spatial navigation (3D and 2D readings) and underground mine scanning in Chile

http://data set.amtc.cl/

Common Crawl

Provides a general open repository of web crawl data since 2013 that can be accessed and analyzed by anyone

https://commoncrawl.org/

The Dat Foundation

Nonprofit group that supports work in community management, user experience, and technical research and development

https://dat.foundation/about/history/

EU Open Data

Provides access to European Union open data

https://data.europa.eu/euodp/en/data

Geoscience Australia

Provides geology data set information

https://data.gov.au/data/

Global Tailings Portal

Provides disclosures from mining companies about their tailings storage facilities

https://tailing.grida.no/

Google

Provides public data sets

https://cloud.google.com/public-data sets

Google

Provides general Google data set discovery and meta data guidelines

https://developers.google.com/search/docs/data-types/data set

Google Data Search

General Google data search tool

https://data setsearch.research.google.com/

Google Landmarks Dataset

This is the second version of the Google Landmarks dataset (GLDv2), which contains images annotated with labels representing human-made and natural landmarks.

https://github.com/cvdfoundation/google-landmark

Government of Canada

Provides data sets of locations for different mining applications in Canada

https://open.canada.ca/data/en/data set?keywords=mines

Homeland Infrastructure Foundation-Level Data (HIFLD)

Provides data sets of locations for different mining applications in the US

https://hifld-geoplatform.opendata.arcgis.com/

IBM

Provides open data sets

https://developer.ibm.com/exchanges/data/

Kaggle

Provides production plant data for condition monitoring

Link: https://www.kaggle.com/inIT-OWL/production-plant-data-for-condition-monitoring

License: https://creativecommons.org/licenses/by-sa/3.0/

Kaggle

Provides a data set about a flotation plant and iron ore concentration process

Link: https://www.kaggle.com/edumagalhaes/quality-prediction-in-a-mining-process

License: https://creativecommons.org/publicdomain/zero/1.0/

Kaggle

Provides records of accidents from 12 different plants in three different countries

Link: https://www.kaggle.com/ihmstefanini/industrial-safety-and-health-analytics-database

License: https://creativecommons.org/publicdomain/zero/1.0/

Microsoft Azure

Provides curated open data sets

https://azure.microsoft.com/en-us/services/open-data sets/catalog/

MINEDEX

Provides a spatial and textual database with data on mining and exploration sites and projects in WA

Link: https://www.dmp.wa.gov.au/Mines-and-mineral-deposits-1502.aspx

License: https://creativecommons.org/licenses/by/4.0/

Minelib

Shows block models of open pit mines for planning optimization benchmarking

http://mansci-web.uai.cl/minelib/

Natural Language Processing Data Set

Provides a comprehensive set of Natural Processing Language data sets

https://data sets.quantumstat.com/

NSW Government

Provides open data sets for the Department of Planning, Industry, and Environment

https://www.planningportal.nsw.gov.au/opendata/?tags=Mining&_tags_limit=0

Ontario Government

Provides government data sets for Ontario

https://www.ontario.ca/page/sharing-government-data

OpenML

Experiment database for machine learning on which users can upload data sets

https://www.openml.org/search?type=data

Process Mining

Provides process mining data sets, real-life event logs, and synthetic events

http://www.processmining.org/logs/start

Queen’s University Dataverse

Key mining example : Gingras Little, K., McKinnon, S., Moreau-Verlaan., L., McDonald, A. (2017). Analysis of Strainbursts in the Sudbury Region and Numerical Modelling of Destress Blasting.

Data set

https://doi.org/10.5683/SP/4RFHBJ

Queensland Government

Provides Queensland Government Open Data Portal (mining data sets)

https://www.data.qld.gov.au/data set?tags=mining

Shahid Bahonar University Department of Mechanical Engineering

Shows images of rocks post blasting

Link: https://data.mendeley.com/data sets/z78ghz96bn/1

License: https://creativecommons.org/licenses/by/4.0/

ToyADMOS

Provides anomaly detection in machine operating sounds

Link: https://github.com/YumaKoizumi/ToyADMOS-data set