• In class quizzes (10%): Online (Canvas) quizzes covering theoretical concepts.
• Assignments (40%): Students will implement various RL algorithms. Note that not all assignments bare the same weight in the final grade.
• Project (50%): Students will work in teams on research projects. Students will submit a project proposal, literature survey, and a final technical paper.
  • Project proposal: 5%
  • Literature survey: 10%
  • Final technical paper: 20%
  • Source code: 5%
  • A 5-minute mp4 YouTube video: 10%

Grading Scale

• A = 90-100
• B = 80-89
• C = 70-79
• D = 60-69
• F = <60

You are allocated 6 late days for the semester. A late day extends an assignment deadline by 24 hours. You may use up to 2 late days per assignment. Assignments submitted more than 48 hours late will be worth at most 50%, and no credit will be given for submissions more than 72 hours late. This policy ensures that feedback can be provided in a timely manner.

You may use late days on the project proposal (up to 2) and literature review (up to 2). No late days are allowed for the YouTube video or final report. Any late days used on the final report will reduce the potential project score by 25%. To use a late day on the project proposal or literature review, all group members must have at least one late day remaining—late days cannot be pooled across members.

Late days should be used for circumstances that qualify as excused absences according to Texas A&M University Student Rule 7 . Please review Student Rule 7 in its entirety for details on what constitutes an excused absence, the types of documentation required, and the relevant reporting timelines. No justification or supporting documentation will be required when using your allocated 6 late days. However, if you require more than 6 late days during the semester, then valid justification and supporting documentation will need to be provided for all late days, including the initial 6. As a result, it is strongly advised to use late days only when appropriate and to retain documentation that supports your reasons in case additional late days are needed later in the semester.

The university views class attendance and participation as an individual student responsibility. Students are expected to attend class and to complete all assignments. Please refer to Student Rule 7 in its entirety for information about excused absences, including definitions, and related documentation and timelines.

Students will be excused from attending class on the day of a graded activity or when attendance contributes to a student's grade, for the reasons stated in Student Rule 7, or other reason deemed appropriate by the instructor. Please refer to Student Rule 7 in its entirety for information about makeup work, including definitions, and related documentation and timelines.

Absences related to Title IX of the Education Amendments of 1972 may necessitate a period of more than 30 days for make-up work, and the timeframe for make-up work should be agreed upon by the student and instructor (Student Rule 7, Section 7.4.1).

"The instructor is under no obligation to provide an opportunity for the student to make up work missed because of an unexcused absence" (Student Rule 7, Section 7.4.2).

Students who request an excused absence are expected to uphold the Aggie Honor Code and Student Conduct Code. (See Student Rule 24).

"An Aggie does not lie, cheat or steal, or tolerate those who do."

"Texas A&M University students are responsible for authenticating all work submitted to an instructor. If asked, students must be able to produce proof that the item submitted is indeed the work of that student. Students must keep appropriate records at all times. The inability to authenticate one's work, should the instructor request it, may be sufficient grounds to initiate an academic misconduct case" (Section 20.1.2.3, Student Rule 20).

You can learn more about the Aggie Honor System Office Rules and Procedures, academic integrity, and your rights and responsibilities at aggiehonor.tamu.edu.

Writing:

Use of AI tools, including ChatGPT, is permitted in this course for students who wish to use them. To adhere to our scholarly values, students must cite any AI-generated material that informed their work (this includes in-text citations with quotations and a reference list entry). Using an AI tool to generate content without proper attribution qualifies as academic dishonesty. See AI citing guidelines for how to properly cite AI tools.

Computer Code:

In principle you may submit AI-generated code, or code that is based on- or derived from- AI-generated code, as long as this use is properly documented in the comments: you need to include the prompt and the significant parts of the response. AI tools may help you avoid syntax errors, but there is no guarantee that the generated code is correct. It is your responsibility to identify errors in program logic through comprehensive, documented testing. Moreover, generated code, even if syntactically correct, may have significant scope for improvement, in particular regarding separation of concerns and avoiding repetitions. The submission itself must meet our standards of attribution and validation.

Texas A&M University is committed to providing equitable access to learning opportunities for all students. If you experience barriers to your education due to a disability or think you may have a disability, please contact Disability Resources in the Student Services Building or at (979) 845-1637 or visit disability.tamu.edu. Disabilities may include, but are not limited to attentional, learning, mental health, sensory, physical, or chronic health conditions. All students are encouraged to discuss their disability related needs with Disability Resources and their instructors as soon as possible.

Texas A&M University is committed to fostering a learning environment that is safe and productive for all. University policies and federal and state laws prohibit gender-based discrimination and sexual harassment, including sexual assault, sexual exploitation, domestic violence, dating violence, and stalking.

With the exception of some medical and mental health providers, all university employees (including full and part-time faculty, staff, paid graduate assistants, student workers, etc.) are Mandatory Reporters and must report to the Title IX Office if the employee experiences, observes, or becomes aware of an incident that meets the following conditions (see University Rule 08.01.01.M1):

• The incident is reasonably believed to be discrimination or harassment.
• The incident is alleged to have been committed by or against a person who, at the time of the incident, was (1) a student enrolled at the University or (2) an employee of the University.

Mandatory Reporters must file a report regardless of how the information comes to their attention - including but not limited to face-to-face conversations, a written class assignment or paper, class discussion, email, text, or social media post. Although Mandatory Reporters must file a report, in most instances, you will be able to control how the report is handled, including whether or not to pursue a formal investigation. The University's goal is to make sure you are aware of the range of options available to you and to ensure access to the resources you need.

Students wishing to discuss concerns in a confidential setting are encouraged to make an appointment with Counseling and Psychological Services (CAPS).

Students can learn more about filing a report, accessing supportive resources, and navigating the Title IX investigation and resolution process on the University's Title IX webpage.

Texas A&M University recognizes that mental health and wellness are critical factors that influence a student's academic success and overall wellbeing. Students are encouraged to engage in proper self-care by utilizing the resources and services available from Counseling and Psychological Services (CAPS). Students who need someone to talk to can call the TAMU Helpline (979-845-2700) from 4:00 p.m. to 8:00 a.m. weekdays and 24 hours on weekends. 24-hour emergency help is also available through the National Suicide Prevention Hotline (800-273-8255) or at suicidepreventionlifeline.org.