IC Training Lab.
YASUDA Professional Engineer Office
<Example of managing open data with cloud SQL database>
Fig. 1 Create SQL database on Azure Portal site
Fig. 2 Preparation of CSV data
Fig. 3 Start SQL Database Import and Export Wizard
The other day, our office received an inquiry for technical support.
"For example, GIS data maintenance in the fields of environment, disaster prevention and asset management. "
In relation to this, I examined open data.
1. Significance of open data
The significance and purpose of promoting public data in a form that can be used secondarily and promoting its use are as follows.
(1) Resolution of issues through promotion of public participation and public-private collaboration, economic revitalization
(2) Advancement and efficiency of administration
(3) Improving transparency and trust
2. Definition of open data
Of the public and private data held by the country, local public organizations and businesses, it is easy for anyone to use (process, edit, redistribute, etc.) through
the Internet etc.
Open data is defined as open data that corresponds to any of the following items.
(1) Those for which secondary usable rules have been applied for both for-profit and non-profit purposes
(2) Suitable for machine reading
(3) Available free of charge
Source: DATA.GO.JP website
Http://www.data.go.jp
"Open Data Basic Guidelines"
May 30, 2017
Advanced Information and Telecommunications Network Society Promotion Strategy Headquarters
Public-private data utilization promotion strategy meeting decision
Converting open data into CSV (Comma Separated Values) format makes it easy to handle GIS and other software.
As it is possible to combine or split many related CSV data, it is generally considered to be managed in a database as a common storage.
So, this time, I tried to verify the procedure for batch registration of CSV data in the database.
1. The database uses Microsoft's cloud service Azure SQL database.
2. Use the "SQL Database Import and Export Wizard" as a means of bulk registration.
<Create Azure SQL Database>
Source: https://docs.microsoft.com/ja-jp/azure/sql-database/sql-database-get-started-portal
Azure SQL Database is a service that provides a "database as a service", which when used
Enables execution and scaling of highly available SQL Server databases in the cloud.
Learn how to create a SQL database in Azure Portal and get started.
If you do not have an Azure subscription, create a free account before starting.
- Log in to the Azure portal
- Create SQL Database
- Create server level firewall rules
Created on November 9, 2017
Fig. 4 Mapping of CSV data
Fig. 5 Execution result of importing CSV data into database
