Steps to submit your solution for adjudication:

1. Download the Evaluation Dataset (link coming soon)
2. Notify the CogPilot Team of intended submissions by Febuary 21st, 2023
3. Apply your model to the Evaluation Dataset, and save the inference results in a CSV file, with the format specified below
4. For each challenge task, assemble your package of materials for submitting your solution
   • CSV file of challenge task predictions for the Evaluation Dataset
   • Completed questionnaire about the details of your solution (questionnaire link)
   • The code implementing your solution and instructions on how to run it. Comments and other description of the code will be much appreciated.
   • (Optional) Your Executive Pitch PowerPoint presentation document (template link) 
   • (Optional) A video recording of your Executive Pitch, no longer than 10 minutes, summarizing your solution and what you’ve learned.
5. Complete the submission form below to get an Dropbox File request  link to upload your solution materials for adjudication

For each item, please save the completed materials with the name and task number at the beginning of the filename (e.g., TEAM123_TASK1_dcQuestionnaire.docx”; or “LASTNAME_TASK#_dcQuestionnaire.docx” if submitting as an individual)

You may resubmit as desired until the final submission deadline at 11:59pm on Feb 28th, 2023. 

CSV File Formats for CogPilot Data Challenge 2.0 Task Predictions

For all the runs in the evaluation set, please provide your predictions in a comma-delimited (CSV) file format. The required CSV format is different for each of the two challenge tasks.

Task 1: Difficulty Level Classification

For all the runs in the Evaluation Set, predict the difficulty level (DL) of each run. We will be assessing prediction accuracy of all four difficulty levels. The required columns and formatting are as follows:

*These are the probability scores for the four difficulty levels, which your model uses to make its final prediction.

Task 2: Performance Error Estimation

For all the runs in the Evaluation Set, predict the Cumulative Performance Error of each run. The required columns and formatting are as follows:

** Cumulative performance error is the sum of the three dimensions of flight performance error (airspeed, localizer, and glide slope) computed over the whole run.