Annotation User State TNNN_SD.ush This file type contains information on user-states (interesting emotional and cognitive states) that occured in the session. The whole session is segmented (no gaps). Note that this annotation is completely integrated in the BAS Partitur Format files (BPF) found in 'annot/par' (tiers GES and OCC). The original *.ush files are stored in 'annot/ush'. For each segment begin (second column) and duration (third column) are given in samples (16kHz). Each segment is assigned one of the labels (third column) below (labels in square brackets): 1. neutral [Neutral] 2. joy/gratification (being successful) [Freude/Erfolg] 3. anger/irritation [Ärger/Mißerfolg] 4. helplessness [Ratlosigkeit] 5. pondering/reflecting [Überlegen/Nachdenken] 6. surprise [Überraschung/Verwunderung] 7. unidentifiable episodes [Restklasse] The labels are assigned with respect to the impression of the labeler. Not only the facial expression but also the voice quality or other contextual information is considered. Only the use of words with emotional content, but without an emotional expression is NOT considered as an indicator of a respective emotion/user-state. The intensity of a user-state is labeled in the forth column for the classes 2-6 by: 1. strong [stark] 2. weak [schwach] In parallel to the user-states the USH files also contain a segmentation of occlusions when the hand or pen occlude parts of the face: 8. hand over face [Hand im Gesicht] 9. hand over face/mouth [Hand im Gesicht/Mund] 10. hand over face/nose [Hand im Gesicht/Nase] 11. hand over face/eyes [Hand im Gesicht/Augen] 12. pen over face [Stift im Gesicht] 13. pen over face/mouth [Stift im Gesicht/Mund] 14. pen over face/nose [Stift im Gesicht/Nase] 15. pen over face/eyes [Stift im Gesicht/Augen] 16. face partly not in the range of recording [Teilweise nicht im Bild] 17. other object in face [Objekt im Gesicht] For more information see 'TechDok-NR-17.ps' in the subdir 'doc/techdocs' (German). You may also refer to the following publications: doc/papers/Steininger-02-LREC.pdf doc/papers/Steininger-02-LREC-WS.pdf