All Collections
Chalkmark
Analyze your first-click test results
Segment your participant data in Chalkmark
Segment your participant data in Chalkmark

Review participants first-click tests. Segment results based on question response, participant ID, URL tags and task results.

Updated over a week ago

This article tells you how to use the participant's tab to:

  • review details about your participants and their first-click tests

  • include or exclude participants from your results

  • segment results based on question reponses,participant ID, URL tags, task results and question responses

The Participants table displays useful information about every participant who started your first-click test, and can be used to segment your data.

Understanding included/excluded and abandoned participants

Participants who complete the first-click test are automatically placed in the ‘included in results’ table. Those who don’t complete all tasks (or are rejected by our recruitment panel if you've used it) are placed in the ‘excluded from results’ table.

Participants are automatically marked as 'abandoned' when they don't complete the first-click test - this happens if they've exited the study or the study has timed out. By default, these participants are not included in your results. The same goes for participants who complete 8 tasks in only 4 seconds; you can be quite sure they haven't taken the study seriously. This can skew your data and is usually an indicator that a participant is not fully engaged in the study.

Participants are also considered to have 'abandoned' a study if they don't complete any tasks and if they don't reach the final page (your Thank You page or redirect URL). These participants are automatically excluded from your results.

We place these participants in the "excluded from results" table so that you can choose to include them if you want to. For example, you might see that a participant marked as 'abandoned' has completed 60% of tasks, which will still give you some valid data as Chalkmark tasks are scored individually.

How to include or exclude participants

You can exclude participants by selecting them with the checkbox and clicking the “exclude selected participants” button. This will send them to the “excluded from results” table. When you first look at your results, we recommend you review the data in this tab and remove any. Removing these participants will tighten up your results.

You'll be able to see the time taken, percentages of successful tasks, tasks skipped, and tests completed.

If you use our in-app recruitment service, you'll notice that some participants in the "included" table are flagged. This happens when the tool has picked up that the participant may not have completed the study correctly.

Example of what a flagged participant response looks like

If a participant is flagged, have a quick look through their data, and if you want to replace them, you can do so in-app by clicking the ‘Replace participant’ button.

Create a segment using participant ID, task results , URL tags, and question responses

You can create segments using participant identifier, URL tags, task results and question responses to organize your participant data into meaningful groups and compare trends and surface opportunities.

To create a new segment or edit an existing one, go to Results > Participants > Segments.

If your participants completed a screener survey or pre - or post-study questions with pre-set answers (like multi-choice), you can segment your results based on their responses.

Select the ‘Create segment’ button and select ‘Question response,’ then choose the question and response you want to filter to. You can add multiple conditions and save the segment.

Apply a segment to your results

To select a segment to apply to your results, click on ‘All included participants’ and select your segment from the drop-down menu. This option will apply to all your results.

Tip: If you use our in-app recruitment tool, you can easily replace study participants should you need to. Read more about replacing participants in-app and our participant response flagging feature here.

Did this answer your question?