Scope: the core functionality of the site and the textbook engine (OTE) will be tested. This includes testing all OTE commands, user sign-in/registration, profile editing, textbook submission, chapter navigation, interactive questions and PDF exports.

System Requirements: the tester must complete tests with a device running macOS ≥12 or Windows ≥10. Python 3.9 or later with a Chromium-based browser and an internet connection. For tests concerning the textbook engine, the tester should install Openbook Textbook Engine.

Testers: students, teachers, tutors, and prospective authors

No. Test How it was tested Expected Result Actual Result User Feedback Proposed Modification Evidence Tester Name(s)
1 Create a textbook with the ‘ote create’ command The tester was instructed to install the OTE package.

After, installation, the tester was directed to run ‘ote create my-textbook’ in the shell at a suitable directory. | The user is able to create a textbook. | The user is able to create a textbook. | The tester noted that the command was simple to use and worked as expected | None | ‣ | Alec | | 2 | Create an account and edit profile | The tester was instructed to try and find their way to the registration screen. The tester was then directed to create an account by filling in their credentials.

Next, the tester is prompted to edit their profile details as they wish and save these changes. | The user is able to create an account and edit their profile as they wish. | The user is able to create an account and edit their profile as they wish. | Tester was a little confused by the ‘School’ field not saving but understood after explanation that it is a placeholder field for a theoretical future version of the app that supports schools/classes. | None | ‣ | Alec, Amber, Martin, Vaishnavi | | 3 | Use the textbook reader chapter list to navigate to a certain chapter and then use the video embed on the page | The tester was instructed to click on a certain chapter.

Then, the tester was asked to press play on the video player on the page. | The tester is able to navigate to the chapter and play the video. | The tester is able to navigate to the chapter and play the video. | Tester liked the video feature but suggested the colour scheme of the textbook cover should be changed.

Tester thought that the blank space between the chapters panel and the textbook felt weird. | - Change the colour scheme of the textbook cover

Tester suggested that accepted answers should not be case-sensitive. | - Make accepted answers case-insensitive | ‣ | Alec, Amber, Martin, Vaishnavi | | 5 | Edit a textbook chapter and submit the textbook to Openbook | The tester used the textbook they had created in test 1 to edit 2.md to include some content featuring a video embed and some interactive questions.

The tester was then instructed to create a public GitHub repository to contain this textbook. The tester used the Uploads Centre to submit their repository.

The textbook was approved while logged in as an administrator and its rendered result was tested, including interactive questions. | The tester is able to edit a textbook and submit it to Openbook. After approval, the textbook renders and functions as expected. | The tester is able to edit a textbook. Initially, an error was being thrown when the repository was submitted. The submission was retried a couple of minutes later and worked as expected. After approval, the textbook rendered and functioned as expected. | The tester found the textbook engine easy to understand and use. They had difficulties submitting the textbook but concluded independently that it was likely a problem external to the Openbook system as the submission worked after retrying. | None | ‣ | Alec | | 6 | Export a textbook to PDF | The tester was instructed to figure out how to export a textbook to PDF from the textbook viewer. | The tester can easily determine how to export a textbook to PDF and the function works as expected. | The tester can easily determine how to export a textbook to PDF and the function works as expected. | All testers liked this feature and found it easy to export a textbook to PDF. | None | ‣ | Alec, Amber, Martin, Vaishnavi |