Topic outline

  • Start here >>>

    Collapse all Expand all

    Welcome to the course!

    Proceed as follows:

    1. Preview the course materials, presented in the sections below
    2. If you wish to participate in the course, log in with your user account then enrol here
    3. Explore the sections Course Introduction, Learning Objectives and Outcomes, and Training Setup:
      read carefully, and follow the instructions in these sections
    4. Introduce yourself in the Discussion Forum: you will find it in the Getting help section below; the discussion forum is open to enquiries on either training setup, or the subject matter
    5. Watch the course presentation video
    6. Work through coursework and assessments for Task 1 to 4
    7. Complete the feedback form, and download your certificate!


  • Course Description

    • Introduction

      The overall goal of this training course is to help reduce the significant volume of data that are routinely lost, or must be discarded by users because they are in some way incomplete, inconsistent or unsuitable for the task. Such data loss can afflict any industry or sector. It is widely acknowledged that a primary cause is human error, and poor data management.

      Course Summary

      The learner will be given tabular data (a spreadsheet) containing errors that must be addressed before the data can be used in a GIS. The course will provide practical guidance for identifying those errors and how to correct them. The learner will work initially on tabular data, in Excel. The data will then be imported to QGIS and plotted on the map canvas, for further error identification and correction.

      The course will demonstrate examples of good practice in data management – promoting consistent standardized methods for data formatting, storage, and documentation (metadata). Learners will be encouraged to apply those standards across their teams and their wider organization.

      Now review your Learning Objectives and Learning Outcomes, in the following section.


    • Meet the Team...

      The training team are here to provide help and advice on your learning journey. Post your questions in the discussion forum, in the 'Getting Help...' section below.

      Graeme Hornby

      Graeme Hornby

      Lead Trainer
      WorldPop, University of Southampton

      		 Josie Foster

      Josie Foster

      Support Trainer
      GRID3

      		 Oualid Fouad

      Oualid Fouad

      Support Trainer
      GRID3

  • Learning Objectives and Outcomes

    • Learning Objectives

      Learners will receive detailed instruction on the following:

      • Implementing best practices for data management focused on file management, formatting, storing, and documenting data for use in GIS, specifically:
        • Adopt a consistent file and attribute naming convention and folder structure
        • Understand the importance of maintaining raw and intermediate versions of data files to facilitate traceability of data processing.
        • Start and maintain metadata records for effective and consistent data tracking and accountability (including date captured, data source, version, terms of use, etc.)
      • Understanding the restrictions imposed by GIS when importing tabular data, and consequently being able to identify and correct common errors within table editing software (Excel or other open source alternative)
      • How to import data with GPS locations (latitude and longitude) in a table format into QGIS and plot them on the map canvas
      • Applying methods to identify and correct spatial data errors in QGIS
      • How to determine which spatial data format to adopt when embarking on a project:
        • Overview of available spatial data formats, pros and cons of each
        • Consider the arguments for and against the use of GeoPackage over shapefile
        • Appreciate the benefits of GeoPackage for efficient data storage, stability, and enhanced functionality

      Learning Outcomes

      By the end of the training, learners will attain:

      • An understanding of the vital importance of good data stewardship as the foundation of effective GIS work; how data ultimately determines the quality of analysis
      • A set of data management protocols and procedures, grounded in best practice, to enact when embarking on a new GIS project
      • An understanding of how to critically assess input data, how to troubleshoot and clean data prior to GIS analysis and visulaization
      • An understanding of the importance of enforcing clear data management standards within their organisation and teams, to benefit from greater efficiencies and internal cohesion

  • Training Setup

    • Training prerequisites

      You are expected to have basic IT skills and to be familiar with MS Office applications, particularly Excel, or another spreadsheet application.

      Requirements:

      In order to successfully complete this course you should ensure the following:

      1. You must have sole use of a computer and internet connection, for the duration of the training programme.
    • 2. QGIS desktop software downloaded and installed (Long Term Release, version 3.34)

      This should be organised in advance of the training, as the application installer is a large file (approx. 1GB); once installed you should ensure it is functioning correctly. Follow the Guidance document to download and install QGIS

    • 3. Basic QGIS knowledge

      Ideally, you should have completed the GRID3 QGIS Foundations training programme. Alternatively, you should complete our course on QGIS core functionality, or hold equivalent knowledge.

    • 4. GRID3 training data, downloaded and saved locally:
        • Download all data required for this training course from here:
      TRAINING DATA DOWNLOAD (Zip file; 6.7MB)

        • When the zip file has downloaded, extract the files and save the folder to a location on a local drive, such as directly to your 'C:/' drive; the file path to your data would therefore read:
      C:\GRID3DataMng\

        • Avoid saving GIS files to desktop locations which sync to cloud storage, such as OneDrive or Google Drive for desktop

    • Copyright and Data Usage

      The copyright and intellectual property for all course and training materials are reserved by GRID3 Inc. and its partners. Please cite: © GRID3; grid3.org

      Unless you and/or your organisation have a separate and agreed licence agreement, this work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/4.0/ or send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, USA.

  • Getting Help: Discussion Forum

    • Click below to visit the discussion forum, for any questions you may have, either on your setup e.g. software requirements and troubleshooting, getting familiar with this learning platform etc., or alternatively any questions or ideas relating to the course topic. 

      You are enrolled on this programme, therefore you are part of a learning community... 

      … As part of the community, you will receive email notifications when any member posts a question. You are welcome of course to unsubscribe from these notifications, but we strongly encourage you to engage with fellow learners and respond to their questions, if you are able to help.

      For the duration of this training course, GRID3 trainers will also be monitoring and responding to queries.

    • forum icon
      Forum
      Discussion forum: GIS Data Preparation and Management

  • Course Presentation

    • GIS Data Preparation and Management: video presentation

      Your trainer will introduce the course topic in the following video, covering the essential theory and concepts. The presentation slides are also available as a PDF to view or download – see below.

      Key Themes

      • Data quality – the critical element in GIS
      • Data acquisition and inspection
      • Good practice in data management
      • Choosing spatial data format

    • The presentation slides featured in the video are provided below. Scroll down for links to download the PDF or to view it fullscreen.

      Remember to post your questions, ideas or discussions in the Discussion Forum.

    • resource icon
      File
      Click here to DOWNLOAD presentation slides File
      1.2 MB PDF document
    • resource icon
      File
      Click here to view presentation slides in THIS WINDOW File

  • Practical Task 1: Initial data setup


    • Task 1: Video Guide

      Your trainer will outline the key aspects of this practical task in the video below. Further down the page you will find the accompanying briefing notes (PDF document) with instructions and screenshots for the task. 

      Video Themes:

      • File and folder management
      • Naming conventions
      • Documenting data (metadata)

    • Task 1: Guidance Note

      Ensure that you have correctly downloaded the training data (see Training Setup section). You can view the guidance note on screen or download the PDF and view locally.

    • resource icon
      File
      Click here to view or download the document File
      2.2 MB PDF document Uploaded 30/03/24, 08:01



  • Practical Task 2: Editing tabular data structure outside GIS


    • Task 2: Video Guide

      Your trainer will outline the key aspects of this practical task in the videos below. Further down the page you will find the accompanying briefing notes (PDF document) with instructions and screenshots for the task. 

      Video 1:

      • Transposing data
      • Correcting rows, columns and headers

      Video 2:

      • Combining data from multiple worksheets into one (Excel Power Query, Append function)

    • Practical Task 2: Guidance Note

      You can view the guidance note on screen, or download the PDF and view locally.

    • resource icon
      File
      Click here to view or download the document File
      5.8 MB PDF document Uploaded 5/04/24, 21:41

  • Practical Task 3: Cleaning tabular data outside GIS

    • Task 3: Video Guide

      Your trainer will outline the key aspects of this practical task in the videos below. Further down the page you will find the accompanying briefing notes (PDF document) with instructions and screenshots for the task. 

      Video 1:

      • Categorical data standardization

      Video 2:

      • Duplicated or missing records

    • Practical Task 3: Guidance Note

      You can view the guidance note on screen, or download the PDF and view locally.


    • resource icon
      File
      Click here to view or download the document File
      1.3 MB PDF document Uploaded 15/04/24, 15:33

  • Practical Task 4: Cleaning and managing spatial data in GIS

    • Task 4: Video Guide

      Your trainer will outline the key aspects of this practical task in the videos below. Further down the page you will find the accompanying briefing notes (PDF document) with instructions and screenshots for the task. 

      Video 1:

      • Load and visualize data
      • Metadata and detailed data inspection

      Video 2:

      • Utilizing GIS processing
      • Reassessment and finalization 

    • Practical Task 4: Guidance Note

      You can view the guidance note on screen, or download the PDF and view locally.

    • resource icon
      File
      Click here to view or download the document File
      4.5 MB PDF document Uploaded 7/05/24, 10:26

  • Course Assessment (on completion of tasks)

    • Course Assessments:

      Please note, you should complete the practical tasks before taking this assessment. 

      There are two parts to this course assessment, 1) a multiple choice quiz, and 2) a file upload.

      The goal of this assessment is to ensure that you have understood the key components of this course, GIS data preparation and management.

      Please note the following:

      • There is no restriction on the number of attempts of this assessment, if you do not pass on your first attempt 
      • You should use the Discussion Forum for any queries or guidance
      • Assessment Part 1 (QUIZ) – you will be given your result immediately
      • Assessment Part 2 (file upload) – your submission will be reviewed and graded by the training team; you will be notified in due course
      • Passing this assessment is required for completing your training programme, and receiving your GRID3 certificate. 
    • quiz icon
      Quiz
      Assessment Part 1: QUIZ
      Receive a grade Receive a passing grade

      The quiz contains five questions, and a maximum of 14 points. The questions are designed to ensure your understanding of the tools, techniques and data described in this course. Please note the following:

      • Do not worry if you don't pass first-time! You have unlimited attempts to complete the quiz
      • Refer to the course materials to complete the questions
      • Use the Discussion Forum for any queries or guidance
      • Successful completion of this quiz is required in order to receive your GRID3 certificate

    • quiz icon
      Quiz
      Assessment Part 2: FILE UPLOAD Quiz

      Topic: Data Investigation and Documentation

      To ensure that you have understood the importance of data investigation, error checking and recording issues and concerns, you're now invited to upload the bugsheet that you generated during Practical Task 4. 

      Please note the following:

      • Your submission will be reviewed and graded by the training team; you will be notified by email
      • Do not worry if you don't pass first-time! You are free to try again, and resubmit a new file
      • Use the Discussion Forum for any queries or guidance
      • Passing this assessment is required in order to receive your GRID3 certificate

      Not available unless: The activity Assessment Part 1: QUIZ is complete and passed
    • Once you have successfully completed Assessments 1 and 2 you will be invited to submit feedback on this training and collect your certificate. 

  • Course Feedback and Certificate


    • Feedback Form:

      ...tell us what you think...how was this learning experience? 

      Now that you have gone through all of the course materials and completed your required assessments, we invite you to give us your feedback on this training programme – see the link below.

      ....Cannot click the feedback link below? 

      • You may still have steps to complete (this will be indicated below)


    • Your Training Certificate:

      Once you have submitted the feedback form (above), you will be eligible for your certificate. It will be emailed to you, but you can also download it from the link below.  

      .... Cannot click the link below? You may still have steps to complete (this will be indicated further down)