Quality Assurance
Quality Assurance
Quality Criteria of LivePhoto Images
Once you complete a job, this will be reviewed by our Quality Assurance team.
If your jobs do not pass our Quality Acceptance Criteria (from the preliminary QA), you will receive feedback within 5 days of your submission and will be given another opportunity to re-submit the Live Photo.
✅ All the instructions in the DataForce Contribute job have been followed
✅ No Personal Identifying Information (PII) is present (see more details in the next section).
✅ Text is in the respective language; Depending on your location - Filipino (USA), Catalan (Spain) or Finnish (Finland) Up to 20% in another language is acceptable except for categories where this is not possible (e.g countries where food packaging always exists in 2 or more languages)
✅ Printed text is legible and not blurred or occluded
✅ Handwritten text is not scanned or otherwise digitally created
✅ Not a picture of text appearing on another screen such as TV, iPad, tablet etc, except for Menus on a Screen
✅ Photo has at least 7.9 Megapixel resolution.
✅ 70% of the frame (including background text) is a legible text region.
✅ 90% of the text in the frame (including background text) is legible.
✅ Text is in normal reading direction (e.g. not in a mirror, upside down).
✅ Free from inappropriate, sensitive information or offensive content, including pornography or profanity.
✅ Image does not show a traffic sign.
✅ All images must be taken using the rear camera
✅ No duplicate submissions across participants are accepted. Duplicate determination is based on visual similarity; only the first submitted image will be accepted, and any subsequent visually similar submissions will be rejected.
✅ The image has not been cropped, rotated, been adjusted for brightness, or otherwise edited
✅ The image has not been zoomed manually - only the camera's preset zoom options have been selected
Personal Identifying Information (PII) should NOT be present in the image
If the text contains any Personal Identifying Information (PII), whether your own or related to someone else, this should be covered with e.g. a small piece of paper or other object. The following are considered PII and should NOT be present in any images.
❌Faces - including from personal photographs
❌Names or signatures
❌Contact information of individuals (address, email, phone number, etc)
⭐NOTE: Publicly available information about businesses (that are not sole proprietorship in the name of an individual) IS permitted
❌Credit card numbers or bank details
❌License plates on vehicles
❌Name plates outside private houses
✅ Acceptable: the sender's name has been redacted by a piece of paper before the Live photo was taken
❌Unacceptable: the sender's name has been redacted by digitally editing the photo. We cannot accept digitally altered images.
What happens if the Live Photos I have submitted do not meet the Quality Assurance criteria?
Once you submit a job, this will have to pass 2 rounds of Quality Assurance review.
Round 1, Preliminary QA. If for any reason the job is not accepted, you will receive an email within 5 days of your Live Photo submission stating which job/s have been rejected. You will be able to see the reasons for the rejections in DataForce Contribute in the Completed Jobs section.
Unless otherwise informed, you will still be eligible to claim new jobs in DataForce Contribute and continue submitting Live Photos depending on availability.
Round 2, Final QA If you do not receive any notification after 5 days of submitting a Live Photo, then kindly note, this means it is under final QA (round 2), where more detailed information regarding the image is reviewed. Due to the complexity of this round, the timeline for review is up to 6-8 weeks.
Once the Live Photos you have submitted pass both QA phases, you will receive a notification informing you accordingly.
Kindly note, that contribution is on a first-come, first-served basis, so the project availability may end earlier if there is a lot of contributor interest and activity.
Where can I see the reopened jobs?
Log into the DataForce Contribute App and click on the “In New tab”
Click on the job that has been notified to you via email and you will be able to see if the job has been reopened
3. Click on the image and you will be able to see the feedback and what needs to be corrected.
4. Click the image to replace it and click "Complete task" to submit it once more.
What are the most common reasons for task rejection?
All tasks are reviewed to ensure they align with the provided guidelines. Below are some of the most common (but not exclusive) reasons for task rejection.
Image does not have 70% of text in frame.
Text is not legible
Live Photo does not follow the characteristics stated in the job description.
Live Photo contains PII
Live Photo, does not contain respective language.
Image is digitally edited
Manual zoom has been used