About You & Informed Consent
Tell us about yourself, then read and confirm the consent form before beginning the reviews.
About You
Tell us about yourself and your teaching background.
Consent Form
Evaluation and Iterative Development of Science Education Media Using Teacher Advisory Board Feedback - Dr. Scott J. Warren, PI
Audio Recording Permission
For the Phase 2 focus group only
How the Rating System Works
This review uses a two-part rating system for each dimension. Read through this before you begin so you know what to expect on every page.
Each product has several rating dimensions - things like "Overall effectiveness," "Scientific accuracy," and "Grade-level fit." For every single dimension, you will do the following two things:
Step 1: Rate the quality using 1 to 5 stars. This is your direct answer to the question being asked. Give your honest professional judgment. Rate every dimension, even the ones that are working well - a 5-star rating tells the team this area is strong and does not need revision.
1 star
Poor
Poor
2 stars
Fair
Fair
3 stars
Adequate
Adequate
4 stars
Good
Good
5 stars
Excellent
Excellent
Step 2: If you rated anything below 5 stars, a concern section will appear automatically beneath the stars. This is where you tell the team what the problem is so they can fix it. You will see three things in the concern section:
1. Text box
Write a plain-language description of the concern. Say what the problem is, where it appears in the material, and what it should say or show instead. The team cannot revise the materials without this description.
Write a plain-language description of the concern. Say what the problem is, where it appears in the material, and what it should say or show instead. The team cannot revise the materials without this description.
2. Three sliders (1-5 each)
Severity: How serious is the problem?
Occurrence: How often does it appear in the material?
Learning Impact: How much would it affect teaching and learning?
If you have only a minor observation and no real concern to report, leave all three sliders at 1.
Severity: How serious is the problem?
Occurrence: How often does it appear in the material?
Learning Impact: How much would it affect teaching and learning?
If you have only a minor observation and no real concern to report, leave all three sliders at 1.
3. Risk Priority Number (RPN)
The three slider values multiply together automatically to produce an RPN score from 1 to 125. A higher score means the concern is more urgent. You do not need to calculate anything - it updates as you move the sliders.
The three slider values multiply together automatically to produce an RPN score from 1 to 125. A higher score means the concern is more urgent. You do not need to calculate anything - it updates as you move the sliders.
Worked example:
You are reviewing Scientific Accuracy for a video. The video mostly gets the science right but one scene incorrectly states that pH 6 is basic. You give it 3 stars (Adequate). The concern section appears automatically. In the text box you write: "Around the 2:30 mark, the narrator says pH 6 is basic. pH 6 is acidic. This needs to be corrected and the pH scale shown on screen should reflect this." You then set Severity = 4 (Major - a factual science error), Occurrence = 1 (Isolated - happens once), Learning Impact = 4 (High - students would likely learn it incorrectly). The RPN calculates to 4 x 1 x 4 = 16, a low-priority flag because the error only happens once. If that same error appeared throughout the entire video, you would set Occurrence = 5 (Pervasive), and the RPN would be 4 x 5 x 4 = 80 - critical, revise immediately.
To summarize: stars first on every dimension, then describe concerns if you have any, then use the sliders to rate how serious they are. If you have no concerns for a dimension, simply give it the stars it deserves and move on.
Video 1: The Discovery
Chapter 1 - Environmental observation and scientific method. Amber and Einstein discover contamination at Plum Lake.
Watch the full video before completing this review. The link opens in a new tab on Magiclight.ai - click the play button to start. When finished, return to this tab to complete your ratings.
Watch Video 1
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Video-Specific Ratings - Same as above: rate every dimension with stars first. If you have a concern, describe it and use the sliders. If you have no concerns, leave the sliders at 1.
Readiness & Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change, and any science errors. Be as specific as possible so the team knows what to fix.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings. Please be specific: name the scene or time stamp, describe the error, and explain what the correct information should be.
Video 2: Collecting & Testing Samples
Chapter 2 - Scientific methodology and laboratory procedures. pH testing and mass spectrometry reveal lead contamination.
Watch the full video before completing this review. The link opens in a new tab on Magiclight.ai - click the play button to start. When finished, return to this tab to complete your ratings.
Watch Video 2
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Video-Specific Ratings - Same as above: rate every dimension with stars first. If you have a concern, describe it and use the sliders. If you have no concerns, leave the sliders at 1.
Readiness & Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change, and any science errors. Be as specific as possible so the team knows what to fix.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings.
Video 3: Toxic Lead Explained
Chapter 3 - Environmental chemistry and health effects. Lead toxicity, EPA standards, and pH-solubility relationships.
Watch the full video before completing this review. The link opens in a new tab on Magiclight.ai - click the play button to start. When finished, return to this tab to complete your ratings.
Watch Video 3
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Video-Specific Ratings - Same as above: rate every dimension with stars first. If you have a concern, describe it and use the sliders. If you have no concerns, leave the sliders at 1.
Readiness & Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change, and any science errors. Be as specific as possible so the team knows what to fix.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings.
Video 4: Where Is It Coming From?
Chapter 4 - Geological investigation and environmental forensics. Source identification using maps and seismic data.
Watch the full video before completing this review. The link opens in a new tab on Magiclight.ai - click the play button to start. When finished, return to this tab to complete your ratings.
Watch Video 4
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Video-Specific Ratings - Same as above: rate every dimension with stars first. If you have a concern, describe it and use the sliders. If you have no concerns, leave the sliders at 1.
Readiness & Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change, and any science errors. Be as specific as possible so the team knows what to fix.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings.
Video 5: Humans and Dogs
Chapter 5 - Health assessment and community water safety. Medical testing, chelation therapy, and water treatment systems.
Watch the full video before completing this review. The link opens in a new tab on Magiclight.ai - click the play button to start. When finished, return to this tab to complete your ratings.
Watch Video 5
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Video-Specific Ratings - Same as above: rate every dimension with stars first. If you have a concern, describe it and use the sliders. If you have no concerns, leave the sliders at 1.
Readiness & Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change, and any science errors. Be as specific as possible so the team knows what to fix.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings.
Graphic Novel
Open the graphic novel in Google Drive and read it before completing this review.
The graphic novel opens as a PDF in Google Drive. Click the button below, then click the download icon (or press Ctrl+Shift+S / Cmd+Shift+S) to download and open it in your PDF viewer for the best reading experience. Read the full graphic novel from beginning to end, paying attention to the science content, narrative flow, visual clarity of each panel, and how well text and images work together. When you are finished, return to this tab to complete your review.
Graphic Novel: Pocadillon Falls - Act 1
Open Graphic Novel (Google Drive)
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Graphic Novel - Visual and Narrative Ratings. Rate every dimension below using the 1-5 stars. If you have a concern about any dimension, describe it in the text box and use the sliders to indicate how serious it is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Readiness & Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change, and any science errors. Be as specific as possible so the team knows what to fix.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings.
Plum Lake Curriculum Guide
This guide supports the five Plum Lake video chapters with lesson-by-chapter activities, mathematical problem sets, discussion questions, pacing, and standards alignment for grades 6-8. Open and review it before rating.
This guide opens as a Google Doc in a new tab. Read the full document, including all chapter activities, discussion questions, pacing guide, and assessment rubrics. You can read it in the browser or go to File > Download > PDF to save a copy. When you are finished, return to this tab to complete your ratings.
Plum Lake Curriculum Guide
A teacher-facing curriculum guide aligned to the five Plum Lake videos. Covers pre-viewing activities, scene-by-scene discussion questions, post-viewing activities, mathematical exercises (circle geometry, ratio calculations, unit conversions), chapter-level assessment rubrics, and a 5-week pacing guide. Includes standards alignment to NGSS, CCSS Math, and TEKS for grades 6-8.
Open Curriculum Guide (Google Docs)
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Curriculum-Specific Ratings - Rate every dimension below using the 1-5 stars. If you have a concern, describe it in the text box and use the sliders. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change before classroom use, and any science errors you found. Be as specific as possible so the team knows exactly what to address.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings. Please be specific: name the page or section, describe the error, and explain what the correct information should be.
Water Quality Unit Curriculum Guide
This is a standalone SEPA middle school unit on water quality and lead exposure. It was developed independently of the Plum Lake video series but covers overlapping science content. Read and review the full unit before rating. Two questions below ask whether the unit and the other series materials could work together in a classroom - this is intentional, as the research team wants to understand whether these independently developed resources are coherent when used as a set.
This unit guide opens as a PDF in Google Drive. Click the button below, then click the download icon in Drive (or press Ctrl+Shift+S / Cmd+Shift+S) to download and open it in your PDF viewer. Read the full document, including the unit overview, all four lesson plans, student notebook pages, teacher resources, and answer keys. The unit is approximately 80 pages - plan your time accordingly. When you are finished, return to this tab to complete your ratings.
SEPA Water Quality and Lead Exposure Unit
A four-lesson, 13-period middle school unit (grades 6-8) covering water quality, lead exposure and health effects, groundwater contamination, human treatment and prevention, and environmental remediation. Includes hands-on labs (groundwater contamination model, blood lead level modeling), a kinesthetic chelation therapy simulation, jigsaw readings, a student notebook, and teacher resources. Uses the 5E instructional model. Aligned to TEKS and NGSS.
Open Water Quality Unit Guide (Google Drive)
Core Ratings - Rate every dimension below using the 1-5 stars. Then, if you have any concerns about that dimension, describe them in the text box and use the sliders to rate how serious the concern is. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Curriculum-Specific Ratings - Rate every dimension below using the 1-5 stars. If you have a concern, describe it in the text box and use the sliders. If you have no concerns, leave the Severity, Occurrence, and Learning Impact sliders at 1.
Feedback - Use the fields below to describe your overall impressions, what is working well, what needs to change before classroom use, and any science errors you found. Be as specific as possible so the team knows exactly what to address.
Critical flag: Any concern noted here will be treated as requiring revision regardless of other ratings. Please be specific: name the page or section, describe the error, and explain what the correct information should be.
Closing Observations & Export
Answer the cross-product questions below, then follow the three steps at the bottom to generate, download, and submit your review.
Cross-Product Observations
These questions ask you to reflect across all materials you reviewed. You do not need to repeat concerns you already noted on individual product pages - focus here on patterns you noticed across multiple products, or issues that only become visible when you consider the materials as a set.
Submission
By exporting your review you confirm this reflects your honest professional assessment.
Submitting Your Review
Follow the three steps below to download and submit your review.
Once you have generated and downloaded your files, please email both to the research team:
1
Click Print / Save PDF to save your review summary as a PDF, then attach it to your email.
2
Click Download CSV to save your raw rating data, then attach that file to the same email.
3
Send both files to scott.warren@unt.edu with the subject line: Advisory Board Review - [Your Name].
Thank you for your time and expertise. Your feedback will directly shape the revision of these materials.
How to submit your review: First, click Generate Review Summary - this builds a readable report of all your ratings and comments on this page. Then click Print / Save PDF to save that report as a PDF file on your computer. Then click Download CSV to save your raw rating data as a spreadsheet file. Finally, email both files to scott.warren@unt.edu with the subject line: Advisory Board Review - [Your Name].
Important: Your responses are not saved automatically. Do not close this tab until you have downloaded both files.