CQPweb Concordances

CQPweb

It is also possible to import concordances exported by CQPweb.

1. First of all, you will need to log onto CQPweb (please contact Peter Uhrig for an account and specifically mention you would like access to the instance connected to the Rapid Annotator). Search whatever you are interested in on the navigation page.


Hint: If you get more than 500 results, you may want to use the "Thin" option from the top right menu first to reduce the number of hits.


2. Select "Download" on the same menu. Click on the third top-down button that reads "Download with settings for Rapid Annotador" and save the file (.txt).

Rapid Annotator

Go to the Rapid Annotator webpage. Before getting started with the Rapid Annotator, you need first to sign up. Then, you will be assigned either an experimenter or an annotator profile. Note that only experimenter profiles can both start new projects and add annotators to them.

Create an Experiment

1. After logging in, click on the “Add Experiment” button to start a new project.

The Red Hen Rapid Annotator will process data of the following types: Image, Audio, Text, and Video. Formats allowed for these categories are as the following:

  • Image: jpg, png, gif.
  • Audio: mp3, wma, mp2, wav.
  • Text: txt, html.
  • Video: mov, mp4, wmv, webm.

2. Add an experiment name, description, and type of data in the pop-up dialogue. Select "fromConcordance" and click on “Add Experiment”.


Hint: For audio and video experiments you will be asked to provide time frame boundaries of the file(s) regarding the original source. This info is not mandatory, although to avoid any malfunction set by default one (1) in both cells.


3. Add an experiment name, description, and type of data in the pop-up window. Select "fromConcordance" and click on “Add Experiment”. Click on “Choose Spreadsheet/Concordance” and upload the Concordance file you obtained from the CQPweb query.

Once files are uploaded you can further modify either name or description info by double clicking on them.


4. Press “Start Upload” and wait until the status change and a check is displayed. Otherwise files will be not uploaded. Name and Description columns will be automatically fill out for every file generated.


Settings

Click on the “Settings” button on the main experiment screen. Here you can delete either an annotator, owner or the project itself.

Annotation

Labels and Levels of Annotation

1. Click on “Add Labels” in the options bar. Here you will find three different buttons.


2. To create a new category system for annotation click on “Add Annotation Level” to set a new category (e.g., age, gender) and press “Submit”. On the following pop-up window, you can also decide the order in which the level of annotation is displayed for the item annotation.


3. Below the level name, press “Add Label” and assign the values for this level of annotation. For rapid annotation, you can set a Key Binding for every value belonging to an annotation level. These will be further displayed on the annotation screen. If no key is bound to any label, a key binding will be automatically assigned.

You can add several labels without leaving the pop-up by clicking on "Add Another" button. When you are finished with the values press "submit". Here you can either add another level of annotation or leave this page by pressing “Done”.


4. Back to the Labels page, you can either export or import from other projects levels of annotation.

  • "Make Global" button export all the levels of annotation available in the current project to a pool whereof they can be imported and used in another annotation. Assign a name and click on "Submit".


  • Click on "Import Annotation Levels" to get access to public annotation levels made by the "Make Public" option. Click on "Import" and add the annotation system to your current project.

Getting to Annotate

1. Before beginning to annotate, you will need to add an annotator (at least you) among users who have already signed up. Here, you can also add new owners who will have the same experimenter privileges to add/delete data and annotators.


Hint: You can partionate the total number of files among the annotators assigned to it. Click on "Settings":

And here click on "Data partition". Here you can add the annotators among whom you want to split the total of files.


2. Press "Done" and return to the Homepage. Here click on "Experiment to Annotate". Now, on the Home Screen, go to “Experiments to Annotate”. You will have access to experiments you have been assigned to. By clicking on any experiment, you will see the valid labels and their key shortcuts.


3. Here you can find experiments have been assigned to your account under the privileges of "Annotator". Now you can click on the name of the project you want to work on and start the annotation.


4. On the experiment screen you will carry out the annotation. In the example below, either by clicking on the “adult” button or pressing the “a” key, the value for this level of annotation is saved to the server. As soon as you select any label, the next annotation level (if any) is loaded. After all the levels have been codified for a file, the next one is rendered for annotation. You can see the progress both as a percentage and the number of the file out of the total.


Hints: The “Undo” button resets any annotation you may wish to. After all files are annotated you can either go back to a former stage by clicking "Undo" or "Done" to finished to consolidate the annotation.

The “Turn off/on looping” feature is only available for video and audio files.


Results

1. Go back to "Home" page and click on the experiment. Here press “Settings” on options bar.


2. Click on “View Results”.


3. Here you can see the results of the current project. Finally, in this screen you can either discard all annotations or export them onto your computer as an .xls spreadsheet.