NovaStar Program Reference / Data Collection / Overview

Data collection programs communicate with stations to collect data and load data reports into the NovaStar database. These programs focus on station observations. See also the Data Import programs, which are used for ad hoc data loading, and sharing data between systems (e.g., SHEF import).

• Introduction
• ALERT, ALERT2, and Custom Data Collection
• HydroLynx 50386 Data Collection
• HydroLynx 5096 Data Collection
• HydroLynx 5400 Data Collection
• Poll Comma Separated Value (CSV) Data
• Poll Corps of Engineers (COE) Reservoir Data
• Poll RAWS Data
• Poll Station Data Collection
• Poll USGS NWIS Data
• Poll (Import) XML Data
• sendrpt and starpt Programs
• Utilities - Overdue Report Check

---

Introduction

A NovaStar can be configured to ingest data from multiple sources and formats. Data collection programs that are used depend on the hardware and communications being used, and format of data. The NovaStar system provides programs that are specific to a data format, and other programs that process simple data formats. The following are general guidelines for selecting an ingest program:

• If continuous low-latency data ingest from serial or internet port is required, for ALERT, ALERT2, or custom formats, use nsrecdata (see ALERT, ALERT2, and Custom Data Collection).
• If custom communication is necessary, use a program designed for the custom data provider. For example, see the programs designed for HydroLynx 50386 and other specific hardware.
• If data can be imported from a file that is periodically updated and made available by FTP, URL download, etc., use a polling program listed on this page or see Data Import programs.

ALERT, ALERT2, and Custom Data Collection

• nsalertxmt - transmit ALERT reports on a serial port
• nsrecdata - ALERT and ALERT2 data collection
• see Data Import nsrecdatalogimport program - used to import data from nsrecdata logs

HydroLynx 50386 Data Collection

• ns50386server - TODO smalers 2017-10-12 need to document
• ns50386xmt - transmit 50386 data packets on a serial port
• nscmdhydro50386 - send a command to a HydroLynx 50386 data collection unit (DCU)
• nsctrlhydro50386 - send a 50386 ScadaLynx control to a remote terminal unit (RTU)
• nspollhydro50386 - poll a HydroLynx 50386 logger
• nsrcvhydro50386 - HydroLynx 50386 receive data
• nstimesync50386 - set time on HydroLynx 50386 DCU
• nstimesync50386all - get list of stations with HydroLynx 50386 poll command and time sync enabled

HydroLynx 5096 Data Collection

• nspollhydro5096 - poll a HydroLynx 5096 logger

HydroLynx 5400 Data Collection

• nspollhydro5400 - poll a HydroLynx 5400 station
• nspollhydro5400logsort - sort nspollhydro5400 log file

Poll Comma Separated Value (CSV) Data

• nspollcsv - poll station data from CSV file

Poll Corps of Engineers (COE) Reservoir Data]

• nspollcoeresvdata - poll station data for COE reservoir

Poll RAWS Data

• nspollrawsdata - poll CDEC/NOAA RAWS station collect data

Poll Station Data Collection

• nsautointer - poll station to collect data
• see Data Import nsautointerlogimport program - used to import data from nsautointer logs

Poll USGS NWIS Data

• nspollusgswaterdata - poll USGS NWIS data

Poll (Import) XML Data

• nsxmlimport - poll (import) XML data
• nsxmltranslate - translate XML data - TODO smalers 2017-10-15 need to document

sendrpt and starpt Programs

• sendrpt - file data report
• starpt - file data report for station and sensor ID

Utilities - Overdue Report Check

• nsoverduechk - check for overdue data reports and create no report alarms