Child pages
  • OpSim Database Architecture
Skip to end of metadata
Go to start of metadata

Database Architecture

The Operations Simulator (OpSim) runs in Python which uses a MySQL database schema (soon to be using SQLite)  consisting of the tables listed here.

	+--------------------------+
	| Tables names             |
	+==========================+
	| Cloud                    |
	| Config                   |
	| Config_File              |
	| Field                    |
	| Log                      |
	| MissedHistory            |
	| ObsHistory               |
	| ObsHistory_Proposal      |
	| Proposal                 |
	| Proposal_Field           |
	| Seeing                   |
	| SeqHistory               |
	| SeqHistory_MissedHistory |
	| SeqHistory_ObsHistory    |
	| Session                  |
	| SlewActivities           |
	| SlewHistory              |
	| SlewMaxSpeeds            |
	| SlewState                |
	| TimeHistory              |
	+--------------------------+

Generally, column names in tables begin with a lowercase character signifying that the column is inherent to the table and is not a foreign key. If a column name begins with an uppercase character, this indicates that the column is a foreign key relationship to another table.

Input Tables

Cloud

A 10-year representation of the weather, as indicated by the cloud cover.

	+---------+------------+------+-----+---------+----------------+
	| Field   | Type       | Null | Key | Default | Extra          |
	+---------+------------+------+-----+---------+----------------+
	| cloudID | int(11)    | NO   | PRI | NULL    | auto_increment |
	| c_date  | bigint(20) | NO   |     | NULL    |                |
	| cloud   | double     | NO   |     | NULL    |                |
	+---------+------------+------+-----+---------+----------------+

Seeing

A 10-year representation of the weather, as indicated by the cloud cover.

	+----------+------------+------+-----+---------+----------------+
	| Field    | Type       | Null | Key | Default | Extra          |
	+----------+------------+------+-----+---------+----------------+
	| seeingID | int(11)    | NO   | PRI | NULL    | auto_increment |
	| s_date   | bigint(20) | NO   |     | NULL    |                |
	| seeing   | double     | NO   |     | NULL    |                |
	+----------+------------+------+-----+---------+----------------+

Field

This is the new description,

Following table shows the columns of the Field table. This table stores the entire visible sky as field centers. The values of fields are pre-calculated and stored in this table during the installation of the Opsim. For a different tesellation of the sky the user can delete the rows are insert a new set of fields to visit for their simulation. ::

	+----------+------------------+------+-----+---------+----------------+
	| Field    | Type             | Null | Key | Default | Extra          |
	+----------+------------------+------+-----+---------+----------------+
	| fieldID  | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| fieldFov | double           | NO   | MUL | NULL    |                |
	| fieldRA  | double           | NO   |     | NULL    |                |
	| fieldDec | double           | NO   |     | NULL    |                |
	| fieldGL  | double           | NO   |     | NULL    |                |
	| fieldGB  | double           | NO   |     | NULL    |                |
	| fieldEL  | double           | NO   |     | NULL    |                |
	| fieldEB  | double           | NO   |     | NULL    |                |
	+----------+------------------+------+-----+---------+----------------+

Output Tables

Config

This is the new description,

Following table shows the columns of the Config table. This table keeps track of the various parameters used to drive the OpSim. Configuration file parameters are kept in this table. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| configID          | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| moduleName        | varchar(64)      | NO   |     | NULL    |                |
	| paramIndex        | int(11)          | NO   |     | NULL    |                |
	| paramName         | varchar(64)      | NO   |     | NULL    |                |
	| paramValue        | varchar(64)      | NO   |     | NULL    |                |
	| comment           | varchar(512)     | YES  |     | NULL    |                |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	| nonPropID         | int(10)          | YES  |     | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

Config_File

This is the new description,

Following table shows the columns of the Config_File table. This table keeps the raw data of the configuration files used to drive the OpSim. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| config_fileID     | int(11)          | NO   | PRI | NULL    | auto_increment |
	| filename          | varchar(45)      | NO   |     | NULL    |                |
	| data              | blob             | NO   |     | NULL    |                |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

Log

This is the new description,

Following table shows the columns of the Log table. This table keeps the code level log statements. These log entries are used to find errors, warnings and used for debugging purposes. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| logID             | int(10)          | NO   | PRI | NULL    | auto_increment |
	| log_name          | varchar(64)      | NO   |     | NULL    |                |
	| log_value         | varchar(512)     | NO   |     | NULL    |                |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

Missed History

This is the new description,

Following table shows the columns of the MissedHistory table. This table keeps track of the Missed Observations for an OpSim run and for a field. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| missedHistID      | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| Session_sessionID | int(10) unsigned | NO   | PRI | NULL    |                |
	| filter            | varchar(8)       | NO   | MUL | NULL    |                |
	| expDate           | int(10) unsigned | NO   |     | NULL    |                |
	| expMJD            | double           | NO   |     | NULL    |                |
	| night             | int(10) unsigned | NO   |     | NULL    |                |
	| lst               | double           | NO   |     | NULL    |                |
	| Field_fieldID     | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

ObsHistory

This is the new description,

Following table shows the columns of the ObsHistory table. This table keeps track of the Observations that were taken by the telescope for an OpSim run and field. ::

	+-------------------+------------------+------+-----+---------+-------+
	| Field             | Type             | Null | Key | Default | Extra |
	+-------------------+------------------+------+-----+---------+-------+
	| obsHistID         | int(10) unsigned | NO   | PRI | NULL    |       |
	| Session_sessionID | int(10) unsigned | NO   | PRI | NULL    |       |
	| filter            | varchar(8)       | NO   | MUL | NULL    |       |
	| expDate           | int(10) unsigned | NO   |     | NULL    |       |
	| expMJD            | double           | NO   |     | NULL    |       |
	| night             | int(10) unsigned | NO   |     | NULL    |       |
	| visitTime         | double           | NO   |     | NULL    |       |
	| visitExpTime      | double           | NO   |     | NULL    |       |
	| finRank           | double           | NO   |     | NULL    |       |
	| finSeeing         | double           | NO   |     | NULL    |       |
	| transparency      | double           | NO   |     | NULL    |       |
	| airmass           | double           | NO   |     | NULL    |       |
	| vSkyBright        | double           | NO   |     | NULL    |       |
	| filtSkyBright     | double           | NO   |     | NULL    |       |
	| rotSkyPos         | double           | NO   |     | NULL    |       |
	| lst               | double           | NO   |     | NULL    |       |
	| alt               | double           | NO   |     | NULL    |       |
	| az                | double           | NO   |     | NULL    |       |
	| dist2Moon         | double           | NO   |     | NULL    |       |
	| solarElong        | double           | NO   |     | NULL    |       |
	| moonRA            | double           | NO   |     | NULL    |       |
	| moonDec           | double           | NO   |     | NULL    |       |
	| moonAlt           | double           | NO   |     | NULL    |       |
	| moonAZ            | double           | NO   |     | NULL    |       |
	| moonPhase         | double           | NO   |     | NULL    |       |
	| sunAlt            | double           | NO   |     | NULL    |       |
	| sunAZ             | double           | NO   |     | NULL    |       |
	| phaseAngle        | double           | NO   |     | NULL    |       |
	| rScatter          | double           | NO   |     | NULL    |       |
	| mieScatter        | double           | NO   |     | NULL    |       |
	| moonIllum         | double           | NO   |     | NULL    |       |
	| moonBright        | double           | NO   |     | NULL    |       |
	| darkBright        | double           | NO   |     | NULL    |       |
	| rawSeeing         | double           | NO   |     | NULL    |       |
	| wind              | double           | NO   |     | NULL    |       |
	| humidity          | double           | NO   |     | NULL    |       |
	| Field_fieldID     | int(10) unsigned | NO   | MUL | NULL    |       |
	+-------------------+------------------+------+-----+---------+-------+

ObsHistory_Proposal

This is the new description,

Following table shows the columns of the ObsHistory_Proposal table. This is a many-to-many relationship table that keeps track of which observations fulfilled which proposals and vice-versa for an OpSim run. ::

	+------------------------------+------------------+------+-----+---------+----------------+
	| Field                        | Type             | Null | Key | Default | Extra          |
	+------------------------------+------------------+------+-----+---------+----------------+
	| obsHistory_propID            | int(10)          | NO   | PRI | NULL    | auto_increment |
	| Proposal_propID              | int(10) unsigned | NO   |     | NULL    |                |
	| propRank                     | double           | NO   |     | NULL    |                |
	| ObsHistory_obsHistID         | int(10) unsigned | NO   | MUL | NULL    |                |
	| ObsHistory_Session_sessionID | int(10) unsigned | NO   |     | NULL    |                |
	+------------------------------+------------------+------+-----+---------+----------------+

Proposal

This is the new description,

Following table shows the columns of the Proposal table. This table keeps track of the various proposals that were used to drive the OpSim. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| propID            | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| propConf          | varchar(255)     | NO   |     | NULL    |                |
	| propName          | varchar(80)      | NO   |     | NULL    |                |
	| objectID          | bigint(20)       | NO   |     | NULL    |                |
	| objectHost        | varchar(80)      | NO   |     | NULL    |                |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

Proposal_Field

This is the new description,

Following table shows the columns of the Proposal_Field table. This is a many-to-many relationship table that keeps track of which fields were requested for which proposals for an OpSim run. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| proposal_field_id | int(10)          | NO   | PRI | NULL    | auto_increment |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	| Proposal_propID   | int(10) unsigned | NO   | MUL | NULL    |                |
	| Field_fieldID     | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

SeqHistory

This is the new description,

Following table shows the columns of the SeqHistory table. This table keeps track of the heirarchical information of the various sequences requested for a proposal, for a field for an OpSim run. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| sequenceID        | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| startDate         | int(10) unsigned | NO   |     | NULL    |                |
	| expDate           | int(10) unsigned | NO   |     | NULL    |                |
	| seqnNum           | int(10) unsigned | NO   |     | NULL    |                |
	| completion        | double           | NO   |     | NULL    |                |
	| reqEvents         | int(10) unsigned | NO   |     | NULL    |                |
	| actualEvents      | int(10) unsigned | NO   |     | NULL    |                |
	| endStatus         | int(10) unsigned | NO   |     | NULL    |                |
	| parent_sequenceID | int(10)          | NO   |     | NULL    |                |
	| Field_fieldID     | int(10) unsigned | NO   | MUL | NULL    |                |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	| Proposal_propID   | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+

SeqHistory_MissedHistory

This is the new description,

Following table shows the columns of the SeqHistory_MissedHistory table. This is a many-to-many relationship table that keeps track of which observations were missed for a sequence and for an OpSim run. ::

	+---------------------------------+------------------+------+-----+---------+----------------+
	| Field                           | Type             | Null | Key | Default | Extra          |
	+---------------------------------+------------------+------+-----+---------+----------------+
	| seqhistory_missedHistID         | int(10)          | NO   | PRI | NULL    | auto_increment |
	| SeqHistory_sequenceID           | int(10) unsigned | NO   | MUL | NULL    |                |
	| MissedHistory_missedHistID      | int(10) unsigned | NO   | MUL | NULL    |                |
	| MissedHistory_Session_sessionID | int(10) unsigned | NO   |     | NULL    |                |
	+---------------------------------+------------------+------+-----+---------+----------------+

SeqHistory_ObsHistory

This is the new description,

Following table shows the columns of the SeqHistory_ObsHistory table. This is a many-to-many relationship table that keeps track of observations achieved for a sequence and for an OpSim run. ::

	+------------------------------+------------------+------+-----+---------+----------------+
	| Field                        | Type             | Null | Key | Default | Extra          |
	+------------------------------+------------------+------+-----+---------+----------------+
	| seqhistory_obsHistID         | int(10)          | NO   | PRI | NULL    | auto_increment |
	| SeqHistory_sequenceID        | int(10) unsigned | NO   | MUL | NULL    |                |
	| ObsHistory_obsHistID         | int(10) unsigned | NO   | MUL | NULL    |                |
	| ObsHistory_Session_sessionID | int(10) unsigned | NO   |     | NULL    |                |
	+------------------------------+------------------+------+-----+---------+----------------+

Session

This is the new description,

Following table shows the columns of the Session table. This is the driver table of an OpSim run. A new table entry is created for every OpSim run and is stored in this table. All output tables have a foreign key relationship with this table and output data is identified primarily using the sessionID column of this table. ::

	+-------------+------------------+------+-----+---------+----------------+
	| Field       | Type             | Null | Key | Default | Extra          |
	+-------------+------------------+------+-----+---------+----------------+
	| sessionID   | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| sessionUser | varchar(80)      | NO   | MUL | NULL    |                |
	| sessionHost | varchar(80)      | NO   |     | NULL    |                |
	| sessionDate | datetime         | NO   |     | NULL    |                |
	| version     | varchar(20)      | YES  |     | NULL    |                |
	| runComment  | varchar(200)     | YES  |     | NULL    |                |
	+-------------+------------------+------+-----+---------+----------------+

SlewActivities

This is the new description,

Following table shows the columns of the SlewActivities table. This table keeps track of the various slew activities for a slew. ::

	+--------------------+-------------+------+-----+---------+----------------+
	| Field              | Type        | Null | Key | Default | Extra          |
	+--------------------+-------------+------+-----+---------+----------------+
	| slewActivityID     | bigint(20)  | NO   | PRI | NULL    | auto_increment |
	| activity           | varchar(16) | NO   |     | NULL    |                |
	| actDelay           | double      | NO   |     | NULL    |                |
	| inCriticalPath     | varchar(16) | NO   |     | NULL    |                |
	| SlewHistory_slewID | bigint(20)  | NO   | MUL | NULL    |                |
	+--------------------+-------------+------+-----+---------+----------------+

SlewHistory

This is the new description,

Following table shows the columns of the SlewHistory table. This table is a one-to-one relationship table between the SlewHistory table and the ObsHistory table. It keeps track of the Slew associated with each Observation for an Opsim run. ::

	+------------------------------+------------------+------+-----+---------+----------------+
	| Field                        | Type             | Null | Key | Default | Extra          |
	+------------------------------+------------------+------+-----+---------+----------------+
	| slewID                       | bigint(20)       | NO   | PRI | NULL    | auto_increment |
	| slewCount                    | bigint(20)       | NO   |     | NULL    |                |
	| startDate                    | double           | NO   |     | NULL    |                |
	| endDate                      | double           | NO   |     | NULL    |                |
	| slewTime                     | double           | NO   |     | NULL    |                |
	| slewDist                     | double           | NO   |     | NULL    |                |
	| ObsHistory_obsHistID         | int(10) unsigned | NO   | MUL | NULL    |                |
	| ObsHistory_Session_sessionID | int(10) unsigned | NO   |     | NULL    |                |
	+------------------------------+------------------+------+-----+---------+----------------+

SlewMaxSpeeds

This is the new description,

Following table shows the columns of the SlewMaxSpeeds table. This table is a one-to-one relationship table between the SlewHistory table and the SlewMaxSpeeds table. This table keeps of the various speeds of the instrument for a slew. ::

	+--------------------+------------+------+-----+---------+----------------+
	| Field              | Type       | Null | Key | Default | Extra          |
	+--------------------+------------+------+-----+---------+----------------+
	| slewMaxSpeedID     | bigint(20) | NO   | PRI | NULL    | auto_increment |
	| domAltSpd          | double     | NO   |     | NULL    |                |
	| domAzSpd           | double     | NO   |     | NULL    |                |
	| telAltSpd          | double     | NO   |     | NULL    |                |
	| telAzSpd           | double     | NO   |     | NULL    |                |
	| rotSpd             | double     | NO   |     | NULL    |                |
	| SlewHistory_slewID | bigint(20) | NO   | MUL | NULL    |                |
	+--------------------+------------+------+-----+---------+----------------+

SlewState

This is the new description,

Following table shows the columns of the SlewState table. This table keeps track of the initial and the final slew states and the various instrument parameters for a slew. ::

	+--------------------+-------------+------+-----+---------+----------------+
	| Field              | Type        | Null | Key | Default | Extra          |
	+--------------------+-------------+------+-----+---------+----------------+
	| slewIniStatID      | bigint(20)  | NO   | PRI | NULL    | auto_increment |
	| slewStateDate      | double      | NO   |     | NULL    |                |
	| tra                | double      | NO   |     | NULL    |                |
	| tdec               | double      | NO   |     | NULL    |                |
	| tracking           | varchar(16) | NO   |     | NULL    |                |
	| alt                | double      | NO   |     | NULL    |                |
	| az                 | double      | NO   |     | NULL    |                |
	| pa                 | double      | NO   |     | NULL    |                |
	| domAlt             | double      | NO   |     | NULL    |                |
	| domAz              | double      | NO   |     | NULL    |                |
	| telAlt             | double      | NO   |     | NULL    |                |
	| telAz              | double      | NO   |     | NULL    |                |
	| rotTelPos          | double      | NO   |     | NULL    |                |
	| filter             | varchar(8)  | NO   |     | NULL    |                |
	| state              | int(10)     | NO   |     | NULL    |                |
	| SlewHistory_slewID | bigint(20)  | NO   | MUL | NULL    |                |
	+--------------------+-------------+------+-----+---------+----------------+

TimeHistory

This is the new description,

Following table shows the columns of the TimeHistory table. This table keeps track of the various different time events that occur for a night for an OpSim run. ::

	+-------------------+------------------+------+-----+---------+----------------+
	| Field             | Type             | Null | Key | Default | Extra          |
	+-------------------+------------------+------+-----+---------+----------------+
	| timeHistID        | int(10) unsigned | NO   | PRI | NULL    | auto_increment |
	| date              | int(10) unsigned | NO   |     | NULL    |                |
	| mjd               | double           | NO   |     | NULL    |                |
	| night             | int(10) unsigned | NO   |     | NULL    |                |
	| event             | int(10) unsigned | NO   | MUL | NULL    |                |
	| Session_sessionID | int(10) unsigned | NO   | MUL | NULL    |                |
	+-------------------+------------------+------+-----+---------+----------------+
  • No labels