Sometimes, pairLab challenges reveal more than just priorities—they show you where you need to dig deeper. You might find yourself stuck between two ideas that don’t really belong in the same challenge. This isn’t a problem—it’s an opportunity for a follow-up expairiment.
When Ideas Overlap
Imagine you’re testing features for a college mobile app. In one pair challenge, participants see:
- A map of campus
- Search a map of campus
On the surface, these ideas seem different. But think about it: Can searching a campus map be more important than the map itself? In reality, the second idea (Search a map of campus) assumes the first.
Ideas like these are too similar, making a direct comparison impossible. The solution is simple: split them into separate studies.
Why You Might Need a Second Expairiment
Ideas often belong to different levels of detail or focus. If one idea overlaps with or depends on another, it’s time to refine your priorities further.
Take “Search a map of campus” as an example. This single idea hints at several features:
- The campus map itself (a basic feature)
- The ability to search the map (a higher-level feature)
If these two ideas appeared in a pair challenge, participants would be stuck. How can you compare a core feature with a dependent one?
The better approach: Test the basic feature first (e.g., A map of campus). If it ranks high, run an additional study to prioritize its subfeatures.
Example: Subfeatures of a Campus Map
Once the basic feature (A campus map) is validated, you can explore subfeatures such as:
- Search the map
- Filter map results by classrooms, parking and dining
- Step-by-step directions
- Accessibility routes
- Show my current position on the map.
- Use the map without an internet connection.
- Locate rooms based on my class schedule.
- Live parking updates
- Campus events locations
- Save my favorite locations
This follow-up expairiment refines your results, giving you a clear picture of what participants value most.
Actionable Takeaways
When ideas overlap, follow these steps to avoid confusion and improve your results:
Identify linked ideas -- Look for ideas that assume or depend on one another. If participants can’t compare them meaningfully, split them into separate studies.
Break ideas into levels -- Start with broad, core features. Once validated, test the enhancements or subfeatures in a follow-up expairiment.
Refine priorities step-by-step -- Don’t overload participants by testing everything at once. Focus on clear, actionable priorities first, then drill down into the details.
Iteration Is Your Friend
A single expairiment gives you initial priorities. A second expairiment refines them. The more you iterate, the clearer and more actionable your results become.
When ideas overlap or depend on each other, don’t force participants to choose. Instead, split them into follow-up studies that allow each idea to stand on its own.