25

Release Testing Plan

Jonathan Thomas edited this page 2024-06-22 18:16:06 -05:00

Table of Contents

• Google Form: Submit your testing results online
• 1. Files
• 2. Clips
• 3. Properties
• 4. Effects
• 5. Projects
• 6. Exports
• 7. Titles
• 8. Misc

The following tests and checks should be done on OpenShot Video Editor before each release. They should also be done on all supported operating systems (Linux, Mac, and Windows). This list of tests is designed to verify the basic features and behavior of OpenShot, and to ensure no major regressions have happened during a release cycle. Please download and use the following Media Test Files.

Google Form: Submit your testing results online

Once all these tests have passed, we are go for launch! 🚀

1. Files

• 1.1 - Drag and drop on Project Files (video, image, audio)
• 1.2 - Delete multiple files from Project Files
• 1.3 - Use Import File dialog (video, image, audio)
• 1.4 - View file properties (video, image, audio)
• 1.5 - Toggle between Thumbnail and Details view
• 1.6 - Preview files (video, image, audio)
• 1.7 - Split clips (video, audio)
• 1.8 - Details view: add tags to files
• 1.9 - Filter files, type (video, audio, image) and tags
• 1.10 - Drag and drop image sequence into Project Files, verify preview and timeline preview works

2. Clips

• 2.1 - Drag and drop Project Files onto timeline (video, image, audio)
• 2.2 - Move single clip, and scrub timeline to verify preview
• 2.3 - Move multiple clips, and scrub timeline to verify preview
• 2.4 - Overlap two clips, transition should be automatically created
• 2.5 - Context menu: fade clip in and out
• 2.6 - Context menu: animate clip in and out
• 2.7 - Slice clip: move playhead over clip, and right click on clip
• 2.8 - Slice clips: move playhead over multiple clips, and right click on timeline
• 2.9 - Remove single clip and multiple clips
• 2.10 - Remove project file, and verify all matching clips are also removed
• 2.11 - Verify snapping toggle works on timeline
• 2.12 - Verify zoom slider works (and CTRL+scroll wheel)
• 2.13 - Verify middle mouse click/drag moves the timeline scrollbars
• 2.14 - Add to Timeline: verify adding multiple clips to timeline works
• 2.15 - Separate Audio: Single Clip (verify new clip appears with a waveform)
• 2.16 - Separate Audio: Multiple Clips (verify multiple clips appear with waveforms)
• 2.17 - Context menu: Time->Fast->2X (verify clip becomes shorter)
• 2.18 - Context menu: Time->Slow->1/2X (verify clip becomes longer)

3. Properties

• 3.1 - Hide properties dock, view clip properties
• 3.2 - Filter properties
• 3.3 - Select 2 clips and use property dropdown to select each clip
• 3.4 - Adjust scale_x, scale_y, location_x, location_y, alpha, and rotation
• 3.5 - Change waveform color property (verify color picker works)
• 3.6 - Remove selected clip when properties are visible

4. Effects

• 4.1 - Filter effects
• 4.2 - Drag and drop chromakey effect
• 4.3 - Adjust color and threshold, and verify color is removed
• 4.4 - Drag and drop bars effect
• 4.5 - Adjust top, bottom, left, and right sides of bars
• 4.6 - Toggle between 2 effects on 1 clip (properties dropdown)
• 4.7 - Remove selected effect, verify effect removal in preview
• 4.8 - Add a common transition (i.e. Circle Out To In) and verify transition covers entire image
• 4.9 - Add an extra transition (i.e. 4 Squares Left Barr) and verify transition covers entire image

5. Projects

• 5.1 - New project should clear the current one (and prompt to save if changes were made)
• 5.2 - Add files (video, audio, image) to project and timeline
• 5.3 - Save project / Save project as: both should prompt for a project location and name
• 5.4 - New project, to clear the saved one above
• 5.5 - Open project, to reload the saved project from above
• 5.6 - Undo/Redo history should still be intact, undo a few times, redo a few times
• 5.7 - Change profile to 'VCD NTSC', verify preview is smaller
• 5.8 - Change profile to 'HD 720p 30 fps', verify preview is clearer
• 5.9 - Full screen button should make window large and small again when toggled
• 5.10 - Verify profile is correctly set when loading saved project

6. Exports

• 6.1 - Simple: choose each profile in list (to verify formats and quality settings load for each one)
• 6.2 - Simple: Export a video: All Formats, MP4 (h.264), high quality (non crf)
• 6.3 - Simple: Export a video: All Formats, MP4 (h.264), low quality (non crf)
• 6.4 - Verify file sizes are different for both videos above
• 6.5 - Simple: Export a video: All Formats, WEBM (vp9), high quality (crf)
• 6.6 - Simple: Export a video: All Formats, WEBM (vp9), low quality (crf)
• 6.7 - Verify file sizes are different for both videos above
• 6.8 - Export a 30 FPS project to 60 FPS (verify Fade in & Fade out is exported correctly)
• 6.9 - Export a 30 FPS project to 24 FPS (verify Fade in & Fade out is exported correctly)

7. Titles

• 7.1 - Set SVG editor path and Blender path in preferences
• 7.2 - Create title, it should appear in Project Files, and preview correctly on timeline
• 7.3 - Edit the created title, both in the title editor, and using Inkscape/Advanced button
• 7.4 - Duplicate title in Project Files, and verify new file is created and previews correctly
• 7.5 - Create animated title, it should appear in Project Files, and preview correctly on timeline
• 7.6 - Test with latest version of Blender (blender.org)

8. Misc

• 8.1 - Verify all help menus work correctly (also test with English and a non-English language)
• 8.2 - Verify version in About screen
• 8.3 - Verify About screen's 3 buttons (Credits, License, and Close)
• 8.4 - Verify credits load with names and data, and filters correctly
• 8.5 - Verify Views->Simple and Views->Advanced work correctly
• 8.6 - Delete ~/.openshot_qt/ folder, and verify initial settings and screen size and layout
• 8.7 - Verify UTF-8 file paths are supported with non-ASCII characters (i.e. a folder named 昨夜, and a project file named 昨夜.osp). Save the project, restart OpenShot, Load the project. Verify all files load, and no errors appear.

Home

1. Community

• Project Goals
• Code of Conduct
• Issue Management and Workflow
• Become a Developer
• Become a Translator

2. Product

• Daily Build Testing Plan
• Release Testing Plan
• Release Plan

3. Troubleshooting

• FAQ
• AppImage Installation
• Blender & Inkscape Guide
• Missing File Prompt
• OpenShot UI too large
• Windows Launch Issues
• Windows Audio Issues
• Windows Debugging with GDB
• Advanced Debugging | Profiling

Want to help improve OpenShot (and make some friends in the process 🤗)? Please consider joining our open-source team by filling out this quick contributor form and introduce yourself! All volunteers are welcome, regardless of skills or skill level. Let's build something amazing!