Document

Welcome to the study!

Please carefully read and acknowledge the Consent to Participants outlined below. By entering your CloudResearch ID and clicking the "Confirm" button, you are verifying that you are 18 years old or older, have normal or corrected-to-normal vision and hearing. Additionally, your participation indicates that you comprehend the conditions outlined for this study and willingly agree to take part in our research.

Please be aware that a computer or laptop is necessary to complete this study; smartphones are not supported. Before proceeding, ensure that you open the browser in full screen.

Your CloudResearch ID:

Experiment Instructions

You are part of an expedition studying aliens on a distant planet. On this planet, aliens extract a blue mineral that is highly valuable to human scientists. Your team plans to hire some of these aliens to mine the mineral for research purposes.

Here is a figure of the blue mineral:

Experiment Instructions

Not all aliens are equally good at mining. Some are highly skilled, while others are less effective. To decide which groups to hire and how much to pay them, your task is to estimate the mining ability of aliens.

The key feature differentiate groups is the eye color. Each group has a unique eye color: red, yellow, and purple. In this study, your captain has assigned you to focus on red-eye aliens and estimate their mining ability.

Experiment Instructions

To understand aliens' mining ability, your team measure their performance in blocks of 10 attempts. In each attempt, an alien either succeeds (earning 1 mineral) or fails (0 minerals). An individual's record is simply the total minerals they collected out of 10.

Your goal is to estimate the red-eyed group's overall capability: how many minerals a red-eye alien would collect in 10 attempts on average. This number represents the group's average mining ability and may include decimals to reflect the overall trend.

Experiment Instructions

To help you estimate this group's mining capability, you will see evaluations from 3 of your teammates. Each teammate independently reviewed the 10-attempt mining records of several red-eyed aliens. They then summarized their findings by providing an estimation of group-level mining ability.

Each teammate's report follows this format: "Based on my assessment, red-eyed aliens collect an average of X minerals per 10 attempts." This value X may include decimals, as it represents the group average rather than the results of a single alien.

By clicking "next", you will start viewing your 3 teammates' reports. Each report will be shown 10 seconds.

The report from your teammate is as follows:

"Based on my assessment, red-eyed aliens collect an average of minerals per 10 attempts."

Loading the report of the next teammate...

Which record do you think was selected by a prior xenopsychologist to describe the number of minerals the red-eye aliens extracted in 10 attempts?

Loading records of the next xenopsychologist...

Experiment Instructions

You have finished reviewing the reports from your 3 teammates. Please provide your estimate of the mining ability of red-eye aliens by completing 20 comparisons.

On each comparison:

You will see two mining records.
Each record represents a possible number of minerals collected in 10 attempts. For example, 4.5 means on average red-eye aliens extract 4.5 minerals out of 10 attempts.
Click the one that feels more accurate for the red-eyed group's average. Once you click, the next comparison will appear automatically.

Here is an example:

Experiment Instructions

In addition to reviewing your teammates' reports, you now will observe the actual mining record of 7 red-eye aliens. Each record shows how many minerals one specific alien extracted in 10 attempts. Each record will be displayed for 4 seconds.

Here is a sample mining record of an alien:

The mining behavior of this alien:

Loading records of the next alien...

Experiment Instructions

Now that you have learned from your teammates and made your own observations, please provide again an estimate of the red-eyed aliens' capability in the same comparison task.

On each comparison (20 in total):

You will see two mining records.
Each record represents a possible number of minerals collected in 10 attempts. For example, 4.5 means on average red-eye aliens extract 4.5 minerals out of 10 attempts.
Click the one that feels more accurate for the red-eyed group's average. Once you click, the next comparison will appear automatically.

Here is an example:

Which record better reflects the average minerals extracted by red-eyed aliens in 10 attempts?

You have finished all trials.
Please complete the following survey.

1. Please enter your age.

2. Please indicate your gender.

Man

Woman

Non-binary

Other

3. Please indicate your race.

White

Black or African American

American Indian or Alaska Native

Asian

Native Hawaiian or Other Pacific Islander

4. What is the highest level of education you have completed?

Less than high school credential

High school credential

Some post-high-school, no bachelor's degree

Bachelor's degree

Graduate degree

5. If you have any feedback about this study (e.g., task clarity, user experience, or anything else), please feel free to share it below.

You have finished all the task! Thank you for your participation.

Your completion code is 2CFF876E6C