App Store And Music Search Evaluator
During this Evaluation project, you will: - Test and evaluate different apps available in an application store to determine the usability, efficiency and overall user experience and intent. This will be done by analyzing the information provided in the application store. -…
- Field
- Data & analytics
- Where
- Australia, Brazil, Canada, Chile, China, France +22 more
- Commitment
- task based
- Versions
- 34 location variants of this role
- Posted
- First posted April 2025, still open (checked today)
Pay data for your profession: Data scientist AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
Among platforms with 10 or more priced data & analytics roles, Alignerr has the highest median ($80/hr across 12 roles) and OpenTrain AI the lowest ($15/hr across 40).
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open data & analytics roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 5 | $85/hr | Business Intelligence Analyst Talent Network$70-120/hr |
| Alignerr | 12 | $80/hr | AI Data Quality Analyst$40-120/hr |
| micro1 | 7 | $23/hr | Senior Technical Documentation, Parts and Annotation Specialist$20-60/hr |
| OpenTrain AI | 47 | $15/hr | Product Analytics and Experimentation Expert (English)$115/hr |
The full listing
As posted on OneForma. See the original
About This Project
During this Evaluation project, you will:
- Test and evaluate different apps available in an application store to determine the usability, efficiency and overall user experience and intent. This will be done by analyzing the information provided in the application store.
- Evaluate different music queries and their results to determine the usability, efficiency and overall user experience and intent. This will be done by analyzing the information provided in a music application as well as doing side searches on Google, Bing, YouTube to help users understand the intent of each query.
Why This Work Matters
This project will improve the way a music services application as well as other apps function to enhance user experience in future versions.
Requirements
- You are based in one of the countries included in the application page and using the locale’s App Store
- You have a valid Apple ID
- You have an iOS Device
- You are native or fluent speaker of one of the languages included in the list, and have a very high level of English
- You pass the required certification in OneForma platform
Project Details
- We will provide thorough instructions and guidelines to ensure you understand the nature of the work and perform successfully.
- Please take your time before proceeding to the certification and make sure to ask any questions you may have about the Guidelines before taking the exam as test attempts are limited.
From applying to your first payment on OneForma
- 1
Build your profile
Create a OneForma profile with your background, languages and domains. OneForma says it takes about five minutes and needs no resume.
- 2
Apply to this project
Apply to the project in your language. Many projects are limited to native speakers in one country, and specialist projects may ask for proof of qualifications.
- 3
Work at the project's rate
Each project sets a fixed rate, shown before you accept.
- 4
First payment
OneForma pays through PayPal, Payoneer or Tremendous with no platform fees, on a twice-monthly cycle with no minimum threshold.
Sources: OneForma: How OneForma works, OneForma: home page and FAQ, OneForma project page: Pegasus Search Evaluator (Taiwan)
Full OneForma profile: watch-outs and the public record →Pay history
What workers report about OneForma
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other data & analytics roles
- Spatial Data AnalystHandshake AIUp to $125/hr
- AI Data Quality AnalystAlignerr$40-120/hr
- Business Intelligence Analyst Talent NetworkMercor$70-120/hr
- Data Analysis ExpertMercor$70-120/hr
- Data Labeling SpecialistAlignerr$40-120/hr
- E-commerce Data AnalystAlignerr$40-120/hr