General Guidelines Overview
Welcome to
the Search Quality Rating
Program!
As a Search
Quality evaluator, you will work
on many
different
types of
rating projects. The General
Guidelines primarily
cover Page
Quality (PQ) rating and
Needs Met
(NM) rating; however, the concepts
are also
important for many other
types of
rating tasks.
For brevity, we
refer to
“Search Quality Evaluators” as
“raters” in these guidelines.
0.0 Introduction to Search Quality Rating
0.1 The Purpose
of Search Quality Rating
Your ratings will
be used
to evaluate
search
engine quality around the world. Good
search engines
give results
that are
helpful for users in their
specific
language and locale.
It is important
that
you are
familiar with and comfortable
using a
search engine. We encourage you to
be an
expert in Google search! For example,
experiment with using operators (e.g.,
quotes or a dash)
in your
searches or try using Google’s advanced search option.
0.2 Raters Must Represent the User
It is very
important for you to
represent users in the locale you
evaluate. You must be
very familiar
with the
task language
and location
in order
to represent the
experience of users in your
locale. If you do not
have the
knowledge to do this,
please inform your employer/company.
0.3 Browser Requirements
Check with your
employer/company for browser
requirements. You may use
helpful browser add-ons or extensions,
but
please do not use add-ons
or extensions
that interfere
with
or alter
the user
experience of the page.
0.4 Ad Blocking
Extensions
Do not use
add-ons or extensions that
block ads
for Needs
Met rating or Page Quality rating. These add-ons or extensions
may cause
you to
give incorrect ratings. As
a rater, only
use an
ad blocking
extension or add-on if specifically instructed
to do
so in
the project-specific
instructions.
0.5 Internet Safety Information
In the course
of your
work, you
will visit
many different webpages. Some of
them may
harm
your computer
unless you are careful. Please do not download
any executables, applications, or other potentially dangerous
files, or click on any
links that
you are
uncomfortable
with.
It
is strongly recommended that you have
antivirus
and antispyware protection
on your computer. This software must be updated frequently
or your
computer
will not be protected. There
are many
free and for-purchase antivirus and antispyware products
available
on the web.
We suggest that
you only
open files
with which you are comfortable.
The file formats listed
below are
generally considered safe if antivirus
software
is in
place.
● .txt (text file)
● .ppt
or .pptx
(Microsoft
PowerPoint) ● .doc or .docx
(Microsoft Word)
● .xls
or .xlsx
(Microsoft Excel)
● .pdf
(PDF) files
If you encounter
a page
with
a warning
message, such as “Warning-visiting
this web
site may
harm your
computer,”
or if
your antivirus
software warns you about
a page,
you should
not try to visit
the page
to assign a rating.
You may
also encounter
pages that
require RealPlayer or the
Adobe Flash plug-in. These are
generally safe to download.
Không có nhận xét nào:
Đăng nhận xét