This project is on hold INDEFINITELY. I'd love to get the opportunity to come back to it, but don't hold your breath. In the meantime- if you do anything cool with this work, please let me know!
In addition to lots of formal recognition, this project also prepared me for further work in research by equipping me with skills such as;
An elementary understanding of antenna design, construction, and the electrical theories governing the way data is collected and transmitted through an analogue system.
Awareness of software-defined radios and digital signal processing programs, such as Spectrum Lab and HDSDR, (more esoterically, HROFFT and Colorgramme).
Knowledge about algorithm design and implementation for signal processing as an apprentice to an expert in the field.
Mathematical techniques for meaningfully interpreting large data sets, importantly including the application of appropriate statistical methods over meaningful sections of data.
Confidence in data analysis tools MATLAB and Excel to aid in the application of statistical models and data visualization.
Enhanced project presentation skills by designing slideshows, posters, and a blog.
Following this project, I worked for NOAA on their PALMS; THE NEXT GENERATION project - you can find papers online ... maybe I'll make a nice list here one day :)
11/18/18
The final update for all KARL processes!
Dismantled antenna and ELLIOTT system, terminating data collection after a full year of data collection.
Completed Kolorgramme and Nogata for all data collected.
Collected data in Colorgramme form is still available on RMOB. Go to their "archives" for the appropriate month and look for the data - K.E. Slovacek
08/01/18
Added Kolorgramme for the month of July (v1.1c)
Added Nogata entry for the month of July
07/01/18
Added Kolorgramme for the month of June (v1.1c)
Added Nogata entry for the month of June
Nogata is finally here! The next generation of Kolorgramme and Duratogramme, Nogata is the official statistical tool of the KARL project. However, Nogata is much more than a tool for just the KARL project, as now it is open to any radiometeor astronomer who is interested in redefining how they observe and visualize data. Nogata aims to be a user-friendly, universal application for MBC data, and ultimately hopes to lower the barrier to entry for the field as a whole.
Features
Core functionalities:
Daily data plots for Diurnal Variation and Duration
Average day creation, with outlier detection
Polynomial Curve fitting
Sine Curve fitting
Duration Percent of Population pie chart
Hourly meteor forecast (sine and poly)
With this in mind, Duratogramme is officially being decommissioned after the month of April, and all further KARL v2.x data will be available in Nogata. However, due to the fact that KARL v1.x is not yet running in Spectrum Lab, it is not compatible with Nogata, and therefore, will continue to be updated in Kolorgramme until it is ported over to Spectrum Lab.
05/01/18
Added Kolorgramme for the month of April (v1.1c)
Added Duratogramme for the month of April (v2.0)
04/01/18
With an improved MATLAB script for parsing RMOB text data into a format that is easily importable into Kolorgramme, data will continue to be added to Kolorgramme from the v1.1 run on the first of every month.
01/31/18
Data collection for Kolorgramme halted indefinitely to make time to further KARL v2.x development. RMOB will continue to log and publish data from the KARL v1.1 run, but there are no further statistics available on Kolorgramme after this date.
02/15/18 - 11/18/18
Studying Duration
It's time! KARL branches out from studying diurnal variation of all meteors, to studying duration of meteors from a given population.
To do this, a group of Spectrum Lab utilities were added as a parallel process to KARL 1.1.
One of these acts as a filter to mitigate unwanted noise from nearly continuous tones and other sources. (referred to as the Spectrum Lab Filter)
The other acts as the detector that counts meteors and logs their duration. (referred to as the Spectrum Lab Meteor Detector)
Soft transition into Standard Build, data between Beta and Standard Build are fully comparable
01/17/18
Data collected via KARL 2.0 is extremely different from data collected in previous versions, and as such, new data analysis and statistical methods are required.
Using a spreadsheet and graphing utility (Duratogramme), the number of meteors detected at a particular duration are collected and displayed in a few different ways.
Duratogramme-H: A prediction curve for number of possible packets transmitted at different times of day. Version H uses the generated curve fit formula from the KARL 1.1a subset.
Duratogramme-DS and Duratogramme-DK: A representation of the variance from day-to-day of what percentage of the population of meteors was of each length, measured in normalized time slices (DS), and possible packets transmitted (DK).
Duratogramme-EK: Compares measured meteor population to a decaying exponential function. Uses data by time slices.
Pie Chart: Illustrates the breakdown of the total population of meteors by duration measured in possible packets transmitted.
Statistical data is not available at this time, as there is no established data to compare this work to. (wow!)
01/17/18 - 02/15/18
Technical Summary
01/17/18: From Alpha
Formatted data output file
Initialized Duratogramme post-processing
Updated Detection Threshold
12/27/17 - 01/17/18
Technical Summary
12/27/17: Initial commit
01/03/18: Added SL Filter
FFT Autonotch Filter
FFT Bandpass Filter
01/05/18: Updated Detection Threshold
01/08/18: Updated Detection Threshold
12/13/17
At a routine check, the system was found to have been rebooted and returned to the logon screen sometime in the previous night.
Reason for failure: Sometime around 0300, a vital Windows security update was pushed to all systems, bypassing settings to "queue" updates, and restarting Windows 7 computers - including Elliott.
After logging on, KARL processes were restarted with no errors around 0800.
The system was not operational for ~5 hours (?); no data was collected during this time.
As this is the second error of its type, additional time will be spent finding a way to mitigate its impact on data collection.
12/12/17
With the future observation that the peak started to trend towards later hours (likely due to noise), this date was selected as a cutoff point for curve fitting using KARL 1.1.
Internally noted as the KARL 1.1a subset cutoff date.
No parameters were changed, data is fully comparable to future data collected
12/11/17
During an installation procedure to prepare for KARL 2.0, something caused HROFFT to crash.
Reason for failure currently unknown
HROFFT and Colorgramme were restarted as soon as the problem was noted, resolving the issue
The system was not operational for 1.5 hours (1400-1530); no data was collected during this time.
11/17/17
With new data being collected via KARL v1.1, there's now room to add a meaningful statistical analysis.
Using a custom Spreadsheet-Colorgramme hybrid (Kolorgramme, available in the header), each hour is being averaged across days, and the resultant "average day" is being used for most statistics.
Innate to Kolorgramme:
A ratio of the maximum to the minimum (for the average day and per each day), which can be compared to the goal ratio of .25 using percent error.
Standard deviation is being computed per row (hour). This is being used to mark data in the Kolorgramme that falls outside one (italics), or two deviations (blacked out). Data outside two deviations is omitted from further computations (dynamically updated to reflect changes in the average with all data)
The standard deviations are also being combined via Root Mean Square, which produces an "Average Variance". This can be used as a measure of data precision.
Analysis in MATLAB is planned for the future, including a general curve fit, and comparisons to other real data from similar radio meteor stations.
11/16/17
At a routine check, the system was found to have been rebooted and returned to the logon screen sometime in the previous night.
Reason for failure: At 0302, a vital Windows security update was pushed to all systems, bypassing settings to "queue" updates, and restarting Windows 7 computers - including Elliott.
After logging on, KARL processes were restarted with no errors at 0650.
The system was not operational for ~4 hours (0310 - 0650); no data was collected during this time.
11/15/17
At a routine check, it was noted that Colorgramme has "drifted" out of sync with the generation of new HROFFT images.
Reason for failure currently unknown.
In an attempted fix, both programs were restarted. During the restart, an error occurred, causing Colorgramme to "skip" an hour, and look for a file that did not yet exist.
Reason for failure currently unknown.
All programs were terminated, and the system was re-synced with Dimension4, which resolved the issue
The system was not operational for 20 minutes (1550 - 1610); no data was collected during this time.
11/14/17 - 01/31/18
KARL relies on remote television signals to illuminate meteor reflection events so that it can detect them. The selected remote signals are far enough away so that they can only be received at KARL by way of reflection in the upper atmosphere, under normal circumstances.
Seasonal atmospheric changes are now intermittently allowing a small portion of one of these signals to be received as a nearly continuous tone around 710 Hz in the detector. This signal fluctuates in power above and below the detection threshold swamping some meteor pings and potentially being incorrectly counted as a meteor with each fluctuation. To correct for this condition, the HROFFT "filter" parameters were changed from (650, 750) Hz to (720, 736) Hz to temporarily exclude this signal.
This change should also help to mitigate the effects of other atmospheric and terrestrial noise being falsely counted as meteors, as the processed portion of spectrum is now much smaller (less room for erroneous signals).
KARL v1.1 operated with 4 interruptions from 2017_11_14_16_00 to present
11/01/17 - 11/14/17
Initial Commit: started processes
HDSDR
Local Oscillator: 54.300.000
Tune: 54.309.441
IF Bandwidth: 200 kHz
AGC enabled
HROFFT
Signal Level: 5
f1(high): 750 Hz
f2(low): 650 Hz
Colorgramme Lab
Configured .ini file
KARL v1.0 operated continuously with no errors from 2017_11_01_00_00 to 2017_11_14_14_00
10/26/17 - 10/31/17
Elliott
Processor: Intel Core i5-3470 @ 3.2GHz
Memory: 8GB RAM
Storage: 2TB HDD
Operating System: Microsoft Windows 7 Pro 64-bit
10/22/17 - 10/24/17
Machined components to match Moxon Table outputs
Assembled antenna according to CAD and Moxon Table
Developed and machined mounting solution (PVC boom)
Mounted antenna to the banister
10/02/17 - 10/18/17
Starting from an established pattern proposed by LB Cebik's paper "A Simple Fixed Antenna for VHF/UHF Work", a custom Moxon-Turnstile antenna was designed for operation at 54 MHz using a Moxon Ratio Table and 4nec2 antenna modeling software.
The antenna with be deliberately de-tuned to improve its propagation pattern (making it more hemispheric) by adjusting its dimensions off of the Moxon Ratios. These changes in dimensions are reflected in the CAD.
08/09/17
Over a series of meetings and emails, the initial idea for E.T. Phone Home was realized, kick-starting research about MBC and the overall field of radio communications. Some of the most informative resources are listed in the header of this page, and some additional technical papers are listed below.