`9Sc@saddlZddlZddlZddlmZddlTdgZdefdYZdS(iN(ttxt(t*t LidarInputcBs9eZdZdZedddedddedd ded d ded d dedddedddedddeddddeedddedddeddded d!ded"d#ded$d%ded&d'd(ed)d*ded+d,ded-d.ded/d0ded1d2d3ejed4d5d3ejdeed6d7d3ejdeed8d9d3ejdeed:d;d3ejdegZd<Z d=Z d>Z d?Z d@Z dAZdBZdCZdDZdEZdFZdGZdHZRS(Is Input data from a single unprocessed lidar measurement. Attributes: - 'localId': a text that presumedly uniquely identifies the measurement. - 'latitude', 'longitude', 'altitude': geodetic coordinates of the measurement site, in degrees and meters above sea level. - 'startDate', 'stopDate', 'startTime', 'stopTime': time boundaries for the series of lidar shots that constitute the measurement. - 'regNumber': registration number of the lidar channel, denoting its wavelength, polarization, aperture etc. in a uniform way. - 'wavelength': nominal lidar signal wavelength in nanometers. - 'polarization': '0' for unpolarized signal, '1' for Raman signal, '2' and '3' for cross and parallel recievers for a linearly polarized signal. - 'gridStep': (uniform) step of the data grid, in meters. - 'gridZenithAngle': zenith angle of the data grid, in degrees. Real height step is 'gridStep * cos(gridZenithAngle)'. Index zero of the grid corresponds to an along-track segment that has 'gridStep' length and starts at the measurement point. If 'originalZenithAgnles' array is 'None', this will correspond to the actual zenith angle of the lidar measurement; otherwise 'originalZenithAngles' should be used for that. - 'firstDataIndex', 'lastDataIndex': first and last indices of the data grid for which data is present in the arrays. Add 'firstDataIndex' to physical indices of the data arrays to obtain indices of the data grid. - 'accumulation': number of lidar shots combined in this measurement. - 'background': background signal or 0.0 if this signal is a joined one. - 'nonlinearity': estimation of error coefficient describing nonlinearity of the receiving channel. - 'syncNoise': estimation of error coefficient describing the receiver's synchronous noise. - 'nonSyncNoise': estimation of error coefficient describing the receiver's nonsynchronous noise. - 'signal': Numpy array holding the raw lidar signal profile, including the background (unless this signal is a joined one, in which case background signal would had been subtracted during a join operation, whereas portions of the signal itself may had been multiplied by some appropriate factors in order to make the final profile smooth). - 'originalZenithAngles': Numpy array holding zenith angles of the lidar measurements, in degrees, at the given height, before a signal joining operation, or 'None' if this signal is not a joined one. - 'originalSignal': Numpy array holding raw lidar signal values before a signal joining operation, or 'None' if this signal is not a joined one. - 'originalAccumulations': Numpy array holding 'accumulaion's of the original lidar signals, or 'None' if this signal is not a joined one. - 'originalBackgrounds': Numpy array holding 'background's of the original lidar signals, or 'None' if this signal is not a joined one. Attributes that are calculated manually in 'onDataLoaded': - 'gridHeightStep': height step of the data grid (see 'gridStep' and 'gridZenithAngle').tSpecifictlocalIdtIDLocaltVARCHARtlatitudetLatitudetSINGLEt longitudet LongitudetaltitudetAltitudet startDatet StartDatetDATEtstopDatetStopDatet startTimet StartTimetTIMEtstopTimetStopTimet regNumbers Reg Numbertrequiredt wavelengtht Wavelengtht polarizationt PolarizationtSMALLINTtgridSteptSteptgridZenithAngletZenithtfirstDataIndextN1t lastDataIndextN2t accumulationt AccumulationtINTt backgroundt Backgroundt nonlinearityt Nonlineart syncNoisetSynchront nonSyncNoiset NonSynchrontsignaltOLEDatat LONGBINARYtoriginalZenithAnglest ZenithArraytoriginalSignaltOriginalSignalArraytoriginalAccumulationstAccumulationArraytoriginalBackgroundstBackgroundArraysPLidar input file is not a valid Access database or may not be opened for readings8Lidar input: failed to query data from the database files$Lidar input file format is invalid: cCs?|jdks|jdkr"dStjj|j|jSdS(N(RtNoneRtdatetimetcombine(tself((scode\LidarInput.pytgetStartDateTimescCs?|jdks|jdkr"dStjj|j|jSdS(N(RR=RR>R?(R@((scode\LidarInput.pytgetStopDateTimescCs|j|j|jS(s@Return actual zenith angles for the original lidar measurements.(tgetOriginalProfileR5R!(R@((scode\LidarInput.pytgetZenithAnglesscCs|j|j|jS(s@Return actual accumulations for the original lidar measurements.(RCR9R'(R@((scode\LidarInput.pytgetAccumulationsscCs|j|j|jS(s>Return actual backgrounds for the original lidar measurements.(RCR;R*(R@((scode\LidarInput.pytgetBackgroundsscCs!|jdk r|jS|jSdS(s=Return raw signal values for the original lidar measurements.N(R7R=R2(R@((scode\LidarInput.pyt getRawSignalsc Cs|jdkr"|jdkr"dS|jdkrD|jdkrDdS|jdkrf|jdkrfd S|jd kr|jdkrd S|jd kr|jdkrd S|jdkr|jdkrdS|jd kr|jdkrdSdS(sReturn the lidar channel's textual identifier for a retrieval algorithm or 'None' if this lidar data may not be used with any of the retrieval algorithms.g0v@iit355it355Cg0x@it387Rg@t532g@t607Rg@t1064t532CN(ii(ii(ii(RR(R@((scode\LidarInput.pyt getChannelIdsc CsxC|jD]5}t||d(kr dtj|j|Sq W|j|jkrdtj|jdtj|jdtj|jdtj|jdfSd|jkodknsd tj|jd Sd |j ko d kns,d tj|jd S|j dkrUdtj|jdS|j d)kr~dtj|jdS|j dkrdtj|jdSd|j kodknsd tj|jdSd|jko|jkns4dtj|jdtj|jdfS|jdkr]dtj|jdSx=d*D]5}t||dkrdd tj|j|SqdW|j|jd}xd+D]}t||}|d(k rt||krt||j}||j}d&tj|j|tj|tj|fSqW|jd(k rtj|jdkstj|jdkrd'tj|jd"Snd(S(,s}Return an error message describing the malformed data or 'None' if the attribute values are plausible and consistent.s"%s database field contains no datas6%s/%s and %s/%s database field values are inconsistentRRRRgVgV@s'%s database field value is out of rangeRgfgf@R gs5%s database field value is less than or equal to zeroRiiiis+%s database field has an inadmissible valueRRR!s0%s and %s database field values are inconsistentR#R%R'R,R.R0s)%s database field value is less than zeroR2R5R7R9R;s7size of the %s database field is %s bytes instead of %ss0one of the items of the %s array is out of rangeN(iiii(R,R.R0(ssignalsoriginalZenithAnglessoriginalSignalsoriginalAccumulationssoriginalBackgrounds(tgetRequiredAttributeNamestgetattrR=Rtquotet getFieldNameRARBRR RRRR!R#R%R'tlentitemsizet quoteNumberR5tnumpytany(R@tnametdataArrayLengtht arrayValuet valueBytest requiredBytes((scode\LidarInput.pytgetErrorMessagesn"    cCsp|jdks|jdkr*d|_n'|jtj|jtjd|_|jdkrld|_ndS(Ngf@t( RR=R!tgridHeigthSteptmathtcostpitgridHeightStepR(R@((scode\LidarInput.pyt onDataLoadeds  !cCsf|dk r|S|dks:|jdks:|jdkr>dS|j|jd}tj|g|S(s\Return a Numpy array holding original signal data regardless of whether 'self' is a raw lidar signal or a joined one. 'originalProfile' has to be the array used to store the data in joined signals, and 'scalarValue' has to be the value of the scalar database field used to store the same data in normal measurements.iN(R=R#R%RWtarray(R@toriginalProfilet scalarValueRZ((scode\LidarInput.pyRC)s  (t__name__t __module__t__doc__t tableNamet DataFieldtFalseRWtfloat32tfieldstopenDatabaseErrorMessagetqueryFailureErrorMessagetinvalidFormatErrorPrefixRARBRDRERFRGROR^ReRC(((scode\LidarInput.pyRsX8            W ( R>RaRWt common.utilsRtcommon.DataRecordt__all__t DataRecordR(((scode\LidarInput.pyts