Using Data Handling to get rid of Bad/Wrong data

There are many reasons why the wrong data or erroneous data ends up in the .dat files that is being imported into the VDV database. This tip shows how Data Handling can be used to take care of this problem.

  1. Open up the .dat files that is being imported into db.robot.c using text editor (Notepad++ recommended) and remove the bad or erroneous data.
  2. Delete the period containing the bad data from the VDV database.
    Go to: db.robot.c > Edit > Data Handling > Select the correct Site > Click on Delete Data from Station
    Select the time period containing the bad data using the From and To date pickers.
    NOTE: It is alright if some data that is OK is deleted as long it is still in the raw .dat file
  3. Change the Latest Timestamp in db.robot.c.
    Go to: db.robot.c > Edit > Data Handling > Select the correct Site > Change Last Timestamp
    Using the date picker select a timestamp that is older than the From Timestamp in Step 2
    Click on Update Latest Timestamp:
  4. Now the .dat file has been fixed, data has been deleted from the database and the Latest Timestamp has been updated. This will force the db.robot.c to read this time period in the data file again and import the data lines again that are not in the database.

NOTE: When db.robot.c detects updated Modification Time on the .dat file it will open it and check if there is new data in it that has newer timestamp than the Latest Timestamp. If db.robot.c is not importing the new data right away it is possible to manually update the modification time by opening up the .dat file in text editor, click on space then backspace and save. This will not change anything in the data file only update the modification time.