Difference: DiscFixInsufficientData (r6 vs. r5)

Question

I'm using DiscFix to count cycle slips by examining the df.out files and looking for "BD" commands.

While processing RINEX data from Continuously Operating Reference Stations (CORS) using DiscFix in its default configuration, I encountered several days in which the output file (df.out) was empty and the message was "Insufficient Data".

The RINEX files appear to be complete - is DiscFix failing because the data gaps/slips were perhaps too large? Is there a way to know if slips were identified using df.log?

I'm trying not to under-count the slips.

Thanks, Rob

-- RobertSteenburgh - 31 Jan 2011

Rob, I can't tell what's happening without seeing the RINEX file, but most likely there is some problem there. I think DiscFix outputs that message right after reading the file and looking at how much raw data it has. Perhaps you would upload some example RINEX files, with any options you are giving to DiscFix.

-- BrianTolman - 01 Feb 2011

Hello Brian and thank you for your response. I have attached the output logs from DiscFix showing the configuration and error messages. I've also attached the Hatakana compressed RINEX files and TEQC summaries for the two Continuously Operating Reference Staitons (CORS), GNAA and CENA. I chose the first day of 2003, but the behavior was consistent for the entire year - df.out was empty. Thanks, Rob

-- RobertSteenburgh - 02 Feb 2011

Rob,

Thanks for responding. These RINEX files have P1 in the header, but all the P1 values are zero (blank). DiscFix wants to use P1 if it can, but will fall back to C1 if P1 is not available. The RINEX header tells DiscFix that P1 is there, but then all the values are zero; hence it concludes "no data found."

This is a common occurrence in RINEX files, particularly from teqc converters. The gpstk tool RinSum will quickly give you a summary of the contents of a RINEX file; for these files it issues a warning - "P1 should be removed from the header." This tells you that P1 data is actually not there, despite what the header says, and so P1 should be removed from the header.

The fix is either to remove P1 from the file using EditRinex, or simply add the option --forceCA to the DiscFix configuration, this will force it to use C1 and ignore P1.

(And when I go to test the --forceCA fix, I find it doesn't work! How embarrassing. I have now fixed the code and committed the change, so if you will download the latest version and recompile, it should work.)

Let me know if you find any other problems. I'll add to my todo list an item to make DiscFix not be fooled by this 'feature.'

Regards, Brian

-- BrianTolman - 01 Feb 2011

Answer

ALERT! If you answer a question - or have a question you asked answered by someone - please remember to edit the page and set the status to answered. The status is in a drop-down list below the edit box.

Thanks Brian! I really appreciate your prompt diagnosis and response. Thank you also for taking the time to test the solution and to fix the broken bit.

Cheers, Rob

-- RobertSteenburgh - 03 Feb 2011 No such template def TMPL:DEF{PROMPT:supportquery}

i got similar problem when i run DiscFix programme, for standard GPS station data, DiscFix --inputfile bela1500.14o --smooth --dt 30.0 --RinexFile dfbela1500.14o --DCWLFixMaxGap=3000 --DCGFFixMaxGap=250 --DCGFFixSigma=3.6

when i check the output file summary by using RinSum command RinSum --obs dfbela1500.14o i could not see any information of xyz and following message is displaying with this problem i couldnot run ReScor to get Slant TEC information,

C:\Users\admin\Desktop\GPSTK TEC\ISR-1>DiscFix --inputfile bela1500.14o --smoot --dt 30.0 --decimate 30 --force CA --RinexFile dfbela1500.14o --DCWLFixMaxGap=3000 --DCGFFixMaxGap=250 --DCGFFixSigma=2.1 DiscFix, part of the GPS ToolKit, Ver 5.0 8/20/07, Run 2014/12/31 06:11:51DiscFix is writing to log file df.log DiscFix is writing to output file df.out DiscFix timing: 1.620 seconds.

C:\Users\admin\Desktop\GPSTK TEC\ISR-1>RinSum --obs dfbela1500.14o # RinSum, part of the GPS Toolkit, Ver 3.2 7/1/11 rev, Run 2014/12/31 11:41:59 +++++++++++++ RinSum summary of Rinex obs file dfbela1500.14o +++++++++++++ Warning : Failed to read header: text 0:Exception: text 0:Invalid system character "?" location 0:c:\users\bparsons\git\gpstk\dev\src\RinexSatID.hpp:gpstk::RinexSatID::fromString:235

text 1:In record 0 text 2:In file dfbela1500.14o text 3:Near file line 1 location 0:C:\Users\bparsons\git\gpstk\dev\src\Rinex3ObsHeader.cpp:gpstk::Rinex3ObsHeader::reallyGetReco rd:1475 location 1:C:\Users\bparsons\git\gpstk\dev\src\FFStream.cpp:gpstk::FFStream::tryFFStreamGet:154 location 2:c:\users\bparsons\git\gpstk\dev\src\FFStream.hpp:gpstk::FFStream::conditionalThrow:188 location 3:c:\users\bparsons\git\gpstk\dev\src\FFStream.hpp:gpstk::FFStream::conditionalThrow:188

Header dump follows.


REQUIRED ---------------------------------- Rinex Version 2.10, File type Observation, System G (GPS). Prgm: , Run: , By: Marker name: , Marker type: . Observer : , Agency: Rec#: , Type: , Vers: Antenna # : , Type : Position (XYZ,m) : (0.0000, 0.0000, 0.0000). Antenna Delta (HEN,m) : (0.0000, 0.0000, 0.0000). Time of first obs -002/12/01 00:00:00.000 UNK (This header is NOT VALID RINEX 2.10) valid = 0 allValid = 1 ~v & aV = 1 Invalid header records: Version / Type Pgm / Run By / Date Marker Name Observer / Agency Receiver # / Type Antenna Type Antenna Position Antenna Delta HEN # / TYPES OF OBSERV Time of First Obs Sys / Phase Shifts END OF HEADER END Invalid header records.


OPTIONAL ----------------------------------


END OF HEADER -------------------------------- RinSum timing: processing 0.127 sec, wallclock: 0 sec.

-- CPrasannaSimhaSimha - 31 Dec 2014 No such template def TMPL:DEF{PROMPT:supportquery}

  • cena0010.03S: TEQC Summary file for CENA 2003001 from National Geodetic Survey
  • gnaa0010.03S: TEQC Summary file for GNAA 2003001 from National Geodetic Survey
IAttachmentActionSizeDateWhoComment
cena0010.03Sbela1500.14o03S 14o cena0010.03S bela1500.14o manage18.8 4389.2 K 02 Feb 2011 31 Dec 2014 - 15:17 07:02 RobertSteenburgh CPrasannaSimhaSimha TEQC Summary GPS station observation file for CENA 2003001 from National Geodetic Survey
cena0010.03dcena0010.03S03d 03S cena0010.03d cena0010.03S manage860.5 18.8 K 02 Feb 2011 - 15:15 15:17 RobertSteenburghCompressed RINEX TEQC Summary file for CENA 2003001 from National Geodetic Survey
df_cena.logcena0010.03dlog 03d df_cena.log cena0010.03d manage15.3 860.5 K 02 Feb 2011 - 15:13 15:15 RobertSteenburghDiscFix Compressed RINEX file for CENA 2003001 Log File for CORS site CENA on 2003001
df_gnaa.logdf_cena.loglogdf_gnaa.log df_cena.log manage15.0 15.3 K 02 Feb 2011 - 15:14 15:13 RobertSteenburghDiscFixLog File for CORS site GNAA CENA on 2003001
gnaa0010.03Sdf_gnaa.log03S log gnaa0010.03S df_gnaa.log manage18.9 15.0 K 02 Feb 2011 - 15:18 15:14 RobertSteenburgh TEQC Summary file for GNAA 2003001 from National Geodetic Survey DiscFix Log File for CORS site GNAA on 2003001
gnaa0010.03dgnaa0010.03S03d 03S gnaa0010.03d gnaa0010.03S manage836.0 18.9 K 02 Feb 2011 - 15:16 15:18 RobertSteenburghCompressed RINEX TEQC Summary file for GNAA 2003001 from National Geodetic Survey
gnaa0010.03d03dgnaa0010.03dmanage 836.0 K 02 Feb 2011 - 15:16RobertSteenburgh Compressed RINEX file for GNAA 2003001

View topic | View difference side by side | History: r6 < r5 < r4 < r3 | More topic actions
 
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback