Import Static Sensor Data (CSV)

Use the Import Static Sensor Data (CSV) option (Geosoft.uxo.gxnet.dll(Geosoft.GX.UXO.UxaImportAdvancedSensors;Run)*) from the AGC Expert User > Static Data Prep and QC menu to import raw data from advanced EM sensors, collected in static mode, into a Geosoft database. 

Import (CSV) Static Sensor Data dialog options

Master database prefix

Select the optional master database prefix.

Script Parameter: UXANALYZE.MASTER_IMPORT_DBPREFIX

Group

Select the group in the master database.

Default group name is FlagList.

Script Parameter: UXANALYZE.MASTER_GROUP

Geo/Grid ID

Specify the Geo/Grid ID, or select from existing values in the Target ID channel. The ID can be an alphanumeric value up to 32 characters in length.

Script Parameter: UXANALYZE.GEO_ID

Input file(s)

Select the input CSV file(s). Each input file is imported into a separate group/ line in the survey database (_Data).

The dialog supports importing data from CSV format.

Script Parameter:UXANALYZE.INPUT_CSV_FILES

Data type

Select the data type. The data type will be included in the database name. For more information on the data types, see the Data Types help topic.

Script Parameter:UXANALYZE.DATA_TYPE

Sensor/configuration

Select the sensor and configuration used to collect the data. The default values are read from the sensor configuration table; refer to Application Notes below.

Script Parameter:UXANALYZE.SENSORNAME

Sensor ID

Specify the Sensor ID, or select from existing values in the Sensor ID channel. The ID can be an alphanumeric value that will identify the sensor used to collect the data.

Script Parameter: UXANALYZE.SENSOR_ID

Height above ground

Specify the height (in meters) of the EM sensors above the ground surface, which has a minimum value of 0. The following default values are read from the sensor configuration table:

  • TEM2x2x3: 0.20 m
  • MetalMapper: 0.16 m
  • MetalMapper2x2: 0.26 m

Script Parameter:UXANALYZE.SENSORHEIGHT

GPS antenna offset (m)

Specify the GPS antenna offset, which is the offset between the GPS antenna and the EM sensors. The default values are read from the sensor configuration table; refer to Application Notes below.

The GPS antenna offset is used to calculate the sensor coils coordinates.

Script Parameter:UXANALYZE.GPSANTENNAOFFSET

Location ID

Select the Location ID from the file header, or from the file name.

If Location ID is to be extracted from the file name, the name should follow A_B.csv pattern, where A and B are alphanumeric and numeric characters, respectively.

Script Parameter:UXANALYZE.LOCATION_ID

GPS coordinates

Use the Edit button to change the GPS coordinate system. The System and Unit text boxes will be populated with the selected coordinate system.

The default values are:

  • Datum: WGS 84
  • Projection: Geographic (Longitude / Latitude)
  • Unit: degrees.

Script Parameters:UXANALYZE.DATUM_GPS, PROJECTION_GPS, LOCAL_TRANSFORM_GPS, UNIT_GPS

Projected survey coordinates

Use the Edit button to change the projected coordinate system for the survey. The System and Unit text boxes will be populated with the selected coordinate system.

The default values are:

  • Datum: NAD83
  • Projection: UTM
    • The UTM zone will be automatically determined when a new input file is entered. If latitude and longitude are missing from the input file, the dialog will look for UTM_E, UTM_N, and UTM_Zone data to determine the UTM zone. If not successful, it will be replaced by "?" for the user to define it manually.
  • Unit: metre.

Script Parameters:UXANALYZE.DATUM_PROJECTED, PROJECTION_PROJECTED, LOCAL_TRANSFORM_PROJECTED, UNIT_PROJECTED

Magnetic declination

Specify the magnetic declination. The value of magnetic declination is added to Yaw when calculating the location.

There is no default value unless IGRF has been calculated. IGRF will be automatically calculated using the location information from the first file imported.

The field is disabled for TEMTADS sensors.

Script Parameter:UXANALYZE.DECLINATION

Database prefix

Specify the prefix for the names of the sensor (_Data) and target (_Target) databases. By default, your databases will be saved in your current project folder. The output database names are displayed below.

Script Parameter:TARGETGDB

Target group

Specify the target group name, which can be a new group.

The default Target group is named, Targets.

Script Parameter:UXANALYZE.TARGETGROUP

Application Notes

The advanced EM sensors collect a massive amount of data that can be exported into a text (CSV) file. When imported into Oasis montaj, the data are read and saved into a pair of Geosoft databases. There are two databases, a survey database (_Data) that contains the raw sensor data, and a target database (_Target) which contains the target and header information.

A third database (_Source) is created when inversion and modelling are performed on the data, and it is used to store the modelling and classification results.

Each input file will be imported as separate groups in the sensor data database (_Data). The target information and the header or parameters are imported into the target database (_Target).

A range of files can be selected to be imported at once, however, only files of the same data type should be selected to be imported simultaneously.

Dates are assumed to be in the US short date standard of MM/DD/YYYY. The tool is designed to create projected coordinates from the GPS coordinates found in the input files. The GPS coordinates are detected by looking for columns that start with LAT (for latitude) and LON (for longitude). If found, the projected channels are named UXA_Y_Raw and UXA_X_Raw.

Examples of Static Sensor Data (CSV) Headers

Target_ID,GPSUTC,Lat,Lon,Elev,GPSCpuTime,GPSFixQ,UTM_E,UTM_N,Elev,CPUms,Heading,Pitch,Roll,PtNo,LineNo,Delt,BlockT,nRepeats,DtyCyc,nStk,AcqMode,GateWid,GateHOff,TxSeq,GateT,TxI_Z,TxI_Y,TxI_X,Rx1Z_TxZ,Rx1Y_TxZ,Rx1X_TxZ,Rx1Z_TxY,Rx1Y_TxY,Rx1X_TxY,Rx1Z_TxX,Rx1Y_TxX,Rx1X_TxX,Rx2Z_TxZ,Rx2Y_TxZ,Rx2X_TxZ,Rx2Z_TxY,Rx2Y_TxY,Rx2X_TxY,Rx2Z_TxX,Rx2Y_TxX,Rx2X_TxX,Rx3Z_TxZ,Rx3Y_TxZ,Rx3X_TxZ,Rx3Z_TxY,Rx3Y_TxY,Rx3X_TxY,Rx3Z_TxX,Rx3Y_TxX,Rx3X_TxX,Rx4Z_TxZ,Rx4Y_TxZ,Rx4X_TxZ,Rx4Z_TxY,Rx4Y_TxY,Rx4X_TxY,Rx4Z_TxX,Rx4Y_TxX,Rx4X_TxX,Rx5Z_TxZ,Rx5Y_TxZ,Rx5X_TxZ,Rx5Z_TxY,Rx5Y_TxY,Rx5X_TxY,Rx5Z_TxX,Rx5Y_TxX,Rx5X_TxX,Rx6Z_TxZ,Rx6Y_TxZ,Rx6X_TxZ,Rx6Z_TxY,Rx6Y_TxY,Rx6X_TxY,Rx6Z_TxX,Rx6Y_TxX,Rx6X_TxX,Rx7Z_TxZ,Rx7Y_TxZ,Rx7X_TxZ,Rx7Z_TxY,Rx7Y_TxY,Rx7X_TxY,Rx7Z_TxX,Rx7Y_TxX,Rx7X_TxX,					
1506,71283.4,35.5861467096667,-85.505731457,573.84,6/22/2012,4,635379.983677985,3939075.17764771,572.412278070657,53514487.5625,20.697736238083,2.71463494551809,1.75933034796464,1,1506,4E-06,0.9,27,0.5,10,2,0.1,5E-05,0,
,,,,,,,,,,,,,,,,,,,,,,,,,24,0.0968272971421598,0.0969210910034212,0.0968242644083301,0.0408771654475625,0.0498901458671944,0.0668421623425583,-0.0293943156702601,0.134653995035417,0.0909938250138859,-0.0514611001900819,0.115139861999496,0.111644434505284,0.0519129305085586,0.0590168545747624,0.00659285440679482,-0.0383188911335575,0.136331542639267,-0.0733405860511297,0.0888208666419916,-0.117587388619205,0.100579967070401,0.116717397837572,-0.0271737058974424,0.0233950476248203,-0.0375926239975657,-0.10652702145865,-0.0381893223424679,-0.0709109255797242,-0.0651462529705386,-0.0350607906593093,0.176921458140493,-0.0645595550840945,-0.09613961740659,0.122836231006285,-0.116911592802648,-0.0748691888527962,0.0324180108221016,-0.0996411199474573,-0.0263676772038726,0.0865355371714105,-0.0714128758753545,-0.0147781173182816,0.0529571726965954,-0.0877191893963383,-0.0425079953348511,0.085914294424425,-0.071835373266321,-0.0810271038668877,0.0450317650160848,-0.0405647488744487,0.0626746700915556,0.0546024904607129,0.128332042885606,-0.0675138890025287,-0.0540421939195576,-0.10232880259163,0.108422088086111,0.0322126907572753,0.0205868266327614,0.0674252446226284,0.120514431285376,0.155519492695817,0.0884948421482368,0.136033999153622,0.154173472481047,0.104094001943185,
						

LineNo/TargetID,PtNo,CPUms,CpuLagTimems,GPSUTCms,Lat,Lon,Elev,GPSCpuTimems,GPSFixQ,GPSHDOP,GPSNSatellites,UTM_E,UTM_N,UTM_Z,Heading,Pitch,Roll,TotalGravity,TotalMag,"FileName","SystemID","JobName","DateTime",Delt,BlockT,nRepeats,nStk,AcqMode,OnePointMode,MultistaticMode,GateWid,GateHOff,nComponentsPerRxSensor,CartHeading,MagneticDeclination,UTMZone,LocalXYOffset_X,LocalXYOffset_Y,SensorHeight,GPSAntenna_OffsetX,GPSAntenna_OffsetY,GPSAntenna_OffsetZ,TxZ_NTurns,TxZ_X,TxZ_Y,TxZ_Z,TxZAxis_Heading,TxZAxis_Pitch,TxZAxis_Roll,TxY_NTurns,TxY_X,TxY_Y,TxY_Z,TxYAxis_Heading,TxYAxis_Pitch,TxYAxis_Roll,TxX_NTurns,TxX_X,TxX_Y,TxX_Z,TxXAxis_Heading,TxXAxis_Pitch,TxXAxis_Roll,RxCube1_X,RxCube1_Y,RxCube1_Z,RxCube2_X,RxCube2_Y,RxCube2_Z,RxCube3_X,RxCube3_Y,RxCube3_Z,RxCube4_X,RxCube4_Y,RxCube4_Z,RxCube5_X,RxCube5_Y,RxCube5_Z,GateT,TxI_Z,TxI_Y,TxI_X,Rx1Z_TxZ,Rx1Y_TxZ,Rx1X_TxZ,Rx2Z_TxZ,Rx2Y_TxZ,Rx2X_TxZ,Rx3Z_TxZ,Rx3Y_TxZ,Rx3X_TxZ,Rx4Z_TxZ,Rx4Y_TxZ,Rx4X_TxZ,Rx5Z_TxZ,Rx5Y_TxZ,Rx5X_TxZ,Rx1Z_TxY,Rx1Y_TxY,Rx1X_TxY,Rx2Z_TxY,Rx2Y_TxY,Rx2X_TxY,Rx3Z_TxY,Rx3Y_TxY,Rx3X_TxY,Rx4Z_TxY,Rx4Y_TxY,Rx4X_TxY,Rx5Z_TxY,Rx5Y_TxY,Rx5X_TxY,Rx1Z_TxX,Rx1Y_TxX,Rx1X_TxX,Rx2Z_TxX,Rx2Y_TxX,Rx2X_TxX,Rx3Z_TxX,Rx3Y_TxX,Rx3X_TxX,Rx4Z_TxX,Rx4Y_TxX,Rx4X_TxX,Rx5Z_TxX,Rx5Y_TxX,Rx5X_TxX,
1 ,1,49807797.2649,16.384,64168900,39.633307155,-104.6323499405,1803.01,49807747.1139,4,0.8,13,531549.760,4387123.758,1803.009,0.18,-0.06,-2.58,512.83,0.00,"stat00001.tem","CDAQ1_MPV3","StaticJob","9/21/2017 1:49:46 PM",4E-06,0.1,1,67,2,-1,0,0.1,5E-05,3,0,8.0416839780597,,0,0,0,0,-1.15,1.37,21,0,0,0,0,90,0,21,0,0,0.34,-45,0,0,21,0,0,0.34,45,0,0,0,0.184,0,-0.184,0,0,0,0,0,0.184,0,0,0,-0.184,0,	
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,+2.400e-05,+7.331e-02,+6.942e-02,+6.937e-02,+1.700e-08,+2.041e-07,+3.057e-08,+9.757e-08,+6.892e-08,-9.471e-08,+3.870e-07,+1.942e-08,-5.707e-08,+2.258e-07,-3.770e-09,+1.889e-07,+2.805e-07,-8.770e-08,-2.224e-07,+1.254e-07,-7.147e-08,-4.074e-08,+2.488e-08,-5.296e-08,+4.618e-08,-3.682e-08,+2.050e-08,-5.021e-08,-1.026e-07,-2.675e-08,+3.556e-10,-1.925e-07,-1.237e-08,+1.623e-07,-1.098e-07,+4.053e-08,+2.764e-08,+3.740e-08,+4.582e-08,+5.262e-09,+2.855e-08,-2.232e-08,-6.008e-08,-1.877e-08,+3.152e-08,+2.893e-08,+1.883e-07,-1.298e-09,-1.662e-07,	

TargetID,Bkgnd,Date,CPUms,GPSUTC,Lat,Lon,HAE,GPSFixQ,UTM_Zone,UTM_E,UTM_N,Elev,Heading,Pitch,Roll,Delt,BlockT,nRepeats,DtyCyc,nStk,AcqMode,GateWid,GateHOff,TxSeq,GateT,TxI_Z,Rx1Z_TxZ,Rx1Y_TxZ,Rx1X_TxZ,Rx2Z_TxZ,Rx2Y_TxZ,Rx2X_TxZ,Rx3Z_TxZ,Rx3Y_TxZ,Rx3X_TxZ,Rx4Z_TxZ,Rx4Y_TxZ,Rx4X_TxZ
11,0,9/23/2014,47155271.27,200429.70,35.353636402,-120.74270937,-30.493,4,10,705109.062,3914599.692,,78.195,4.75685,7.61070,2E-06,0.9,9,0.5,18,2,0.05,5E-05,1
,,,,,,,,,,,,,,,,,,,,,,,,,2.5E-05,0.368998723622435,0.000154755054693685,-3.9039003450574E-05,3.33486405198514E-05,-6.21537339484138E-05,1.30674640175413E-05,1.24262166066315E-05,-2.5871044872345E-05,-5.63886985003959E-06,3.77824816782485E-06,-5.76769315540804E-05,-1.27900658087007E-05,5.20397227711596E-06

During the Import Process:

  • For each input file a unique Target ID is created.
  • The locations of each of the receiver coils in projected coordinates are calculated from the GPS (geographic) coordinates of the array found in the input files. The GPS coordinates are detected by looking for columns that start with LAT (for latitude) and LON (for longitude).
  • The IMU (heading/yaw) data are corrected from magnetic declination.
  • If the current data values are present, the sensor data are normalized to the maximum current.
Master Database

In the master database (if selected), the following channels are created if they don't exist:

  • UXA_Measurement_Number
  • UXA_ACQ_DATE
  • UXA_ACQ_TIME
  • UXA_CSV_FILE
  • UXA_SensorID

As each data file is imported:

  • Read from the master database:
    • the measurement number (UXA_Measurement_Number): increment and use for the measurement id
    • the flag locations (UXA_Flag_X and UXA_Flag_Y)
  • Write to the Master database:
    • Update the measurement number (UXA_Measurement_Number)
    • Store the UXA_ACQ_DATE
    • Store the UXA_ACQ_TIME
    • Store the UXA_CSV_FILE
    • Store the UXA_SensorID
Geo/Grid ID

The Geo/Grid ID can be any alphanumeric value up to 32 characters in length and is intended to clearly define individual grid areas. The Geo/Grid ID is identified in the group/line name in the survey database.

Target ID

The target ID (for example, "01_001_01") is made up of three parts;

  1. The location or flag ID, which is numeric and can be populated from the file header or the file name. If Location ID is to be extracted from the file name, the file name should follow A_B.csv pattern, where A and B are alphanumeric and numeric characters, respectively.
  2. The measurement ID, which is numeric and comprised of three digits and is automatically populated with sequential numbering. If the location ID already exists in the output databases the measurement ID will automatically increment to the next available number.
  3. The source ID, which is comprised of two digits and is populated based on the targets source ID.
Sensor/Configuration Table

The sensor configuration table is a lookup file containing information about the sensors and configuration, such as the relative location of the sensor coil, number of gates, etc. The default sensor/configurations are:

  • MetalMapper: static, standard configuration (8msec and 50 gates)
  • MetalMapper B: static, long time window configuration (25msec and 60 gates)
  • TEM2x2x3: static, standard configuration (25msec and 121 gates)
  • TEMTADS: static, standard configuration (25msec and 121 gates) raw data
  • TEMTADS B - Processed: static, standard configuration (25msec and 121 gates)

You can modify the parameters for the existing sensors or add new sensors to the file. The file "SensorTableAdvanced.xml" is located in the "C:\Program Files\Geosoft\Desktop Applications \etc" folder.

  • If you want to customize the SensorTableAdvanced.xml file, you should manually copy the file to your "%USERPROFILE%\Documents\Geosoft\Desktop Applications \etc" folder (so that you don't lose your changes during a software update).
  • If the Magnetic declination and/or the offset between the GPS antenna and the sensor coils have already been accounted for, prior to importing the data, you should enter zero (0) in the respective fields.

    • *The GX tool will search in the "gx" folder. The GX.Net tools, however, are embedded in the Geosoft.uxo.gxnet.dll located in the bin folder. If running this GX interactively, bypassing the menu, first change the folder to point to the bin folder, then supply the GX.Net tool in the specified format.

    See Also: