LANDSCAPE OF OPEN DATA SETS AND PLATFORMS

4TU Research Data

Provides general research data in science, engineering, and design with mining categories

https://data.4tu.nl/

Australian Government

Provides geospatial data sets and other spatial indexes

https://data.gov.au/data/

Australian Research Data Commons (ARDC)

Provides Australian research communities and industries access to data intensive eInfrastructures, platforms, skills, and collections of data

https://ardc.edu.au

AWS S3 Data sets

Includes data sets provided and maintained by a variety of third parties under a variety of licenses, offers listing services

https://registry.opendata.aws/

BDD100K

A Diverse Driving Dataset for Heterogeneous Multitask Learning

https://www.bdd100k.com/

Canadian Government

Provides ability to search open data relevant to Canadians

https://open.canada.ca/en/open-data

Centre for Open Science

Provides Transparency and Openness Promotion (TOP) Guidelines, 2015, with more than 5000 signatories

TOP Guidelines: https://www.cos.io/top

Signatories: https://www.cos.io/top#tabid4

Centro Avanzado de Tecnología para la Minería (AMTC)

Provides spatial navigation (3D and 2D readings) and underground mine scanning in Chile

http://data set.amtc.cl/

Common Crawl

Provides a general open repository of web crawl data since 2013 that can be accessed and analyzed by anyone

https://commoncrawl.org/

The Dat Foundation

Nonprofit group that supports work in community management, user experience, and technical research and development

https://dat.foundation/about/history/

EU Open Data

Provides access to European Union open data

https://data.europa.eu/euodp/en/data

Geoscience Australia

Provides geology data set information

https://data.gov.au/data/

Global Tailings Portal

Provides disclosures from mining companies about their tailings storage facilities

https://tailing.grida.no/

Google

Provides public data sets

https://cloud.google.com/public-data sets

Google

Provides general Google data set discovery and meta data guidelines

https://developers.google.com/search/docs/data-types/data set

Google Data Search

General Google data search tool

https://data setsearch.research.google.com/

Google Landmarks Dataset 

This is the second version of the Google Landmarks dataset (GLDv2), which contains images annotated with labels representing human-made and natural landmarks.

https://github.com/cvdfoundation/google-landmark

Government of Canada

Provides data sets of locations for different mining applications in Canada

https://open.canada.ca/data/en/data set?keywords=mines

Homeland Infrastructure Foundation-Level Data (HIFLD)

Provides data sets of locations for different mining applications in the US

https://hifld-geoplatform.opendata.arcgis.com/

IBM

Provides open data sets

https://developer.ibm.com/exchanges/data/

Kaggle

Provides production plant data for condition monitoring

Link: https://www.kaggle.com/inIT-OWL/production-plant-data-for-condition-monitoring

License: https://creativecommons.org/licenses/by-sa/3.0/

Kaggle

Provides a data set about a flotation plant and iron ore concentration process

Link: https://www.kaggle.com/edumagalhaes/quality-prediction-in-a-mining-process

License: https://creativecommons.org/publicdomain/zero/1.0/

Kaggle

Provides records of accidents from 12 different plants in three different countries

Link: https://www.kaggle.com/ihmstefanini/industrial-safety-and-health-analytics-database

License: https://creativecommons.org/publicdomain/zero/1.0/

Microsoft Azure

Provides curated open data sets

https://azure.microsoft.com/en-us/services/open-data sets/catalog/

MINEDEX

Provides a spatial and textual database with data on mining and exploration sites and projects in WA

Link: https://www.dmp.wa.gov.au/Mines-and-mineral-deposits-1502.aspx

License: https://creativecommons.org/licenses/by/4.0/

Minelib

Shows block models of open pit mines for planning optimization benchmarking

http://mansci-web.uai.cl/minelib/

Natural Language Processing Data Set

Provides a comprehensive set of Natural Processing Language data sets

https://data sets.quantumstat.com/

NSW Government

Provides open data sets for the Department of Planning, Industry, and Environment

https://www.planningportal.nsw.gov.au/opendata/?tags=Mining&_tags_limit=0

Ontario Government

Provides government data sets for Ontario

https://www.ontario.ca/page/sharing-government-data

OpenML

Experiment database for machine learning on which users can upload data sets

https://www.openml.org/search?type=data

Process Mining

Provides process mining data sets, real-life event logs, and synthetic events

http://www.processmining.org/logs/start

Queen’s University Dataverse

Key mining example : Gingras Little, K., McKinnon, S., Moreau-Verlaan., L., McDonald, A. (2017). Analysis of Strainbursts in the Sudbury Region and Numerical Modelling of Destress Blasting.

Data set

https://doi.org/10.5683/SP/4RFHBJ 

Queensland Government

Provides Queensland Government Open Data Portal (mining data sets)

https://www.data.qld.gov.au/data set?tags=mining

Shahid Bahonar University Department of Mechanical Engineering

Shows images of rocks post blasting

Link: https://data.mendeley.com/data sets/z78ghz96bn/1

License: https://creativecommons.org/licenses/by/4.0/

ToyADMOS

Provides anomaly detection in machine operating sounds

Link: https://github.com/YumaKoizumi/ToyADMOS-data set

License: https://github.com/YumaKoizumi/ToyADMOS-data set/blob/master/LICENSE.pdf

Unearthed

Community of data scientists, developers, and startups working on challenges within the energy and natural resources industries

https://unearthed.solutions/

University of WA

UWA Prognostics Data Library that provides condition monitoring information for academic use and requires registration

https://prognosticsdl.ecm.uwa.edu.au/pdl/

US Government

Provides US government open data, tools, and resources to conduct research, develop web and mobile applications, and design data visualizations

https://www.data.gov/

WA DMIRS

Data sets uploaded by the West Australian Dept of Mines, Industry Regulation and Safety

https://catalogue.data.wa.gov.au

Werner, T., Taneja, L., Huijbregts, M., Northey, S.A., Schipper, A.M., & Mudd, G (researchers)

Published open data set on global-scale remote sensing of mine areas.

Article: Global-scale remote sensing of mine areas and analysis of factors explaining their extent

Data Set: Data for: Global-scale mapping and prediction of mine areas

World Bank

Provides free and open access to global development data

https://data.worldbank.org/