HOT Speech: Hateful, Offensive, Toxic Speech Dataset

A HOT Speech (hate/offensive/toxic speech dataset) dataset of 3,481 social media comments with multi-dimensional annotations, collected by SOMAR / ICPSR via Twitter, YouTube, and Reddit APIs (August 2021). Each record contains comment text, hard and soft labels (hateful, offensive, toxic), composite scores, and 21 researcher codes. multi-platform dataset with rich annotations including both MTurk worker labels and researcher codes. Suitable for hate speech detection, offensive language identification, toxicity classification, and political discourse analysis.

#Icpsr#Mturk#Offensive language#Soft label#Somar

Download data BibTeX JSONSimilar datasets

Analytics

Content metrics

3,481 records scored

hateful hard17.8% true
true 17.8%false 82.2%
offensive hard29.6% true
true 29.6%false 70.4%
toxic hard17.1% true
true 17.1%false 82.9%
hateful soft20.7% true
true 20.7%false 79.3%
offensive soft30.8% true
true 30.8%false 69.2%
toxic soft20.6% true
true 20.6%false 79.4%
composite hateful15.1% true
true 15.1%false 84.9%
composite offensive27.3% true
true 27.3%false 72.7%
composite toxic26.3% true
true 26.3%false 73.7%
code accusation43.1% true
true 43.1%false 56.9%
code behavior5.4% true
true 5.4%false 94.6%
code benign6.8% true
true 6.8%false 93.2%
code context necessary42.0% true
true 42.0%false 58.0%
code directed90.5% true
true 90.5%false 9.5%
code first0.8% true
true 0.8%false 99.2%
code group49.5% true
true 49.5%false 50.5%
code group or individual86.0% true
true 86.0%false 14.0%
code individual39.9% true
true 39.9%false 60.1%
code insult27.1% true
true 27.1%false 72.9%
code misinformation3.3% true
true 3.3%false 96.7%
code multiple behaviors14.8% true
true 14.8%false 85.2%
code namecalling29.7% true
true 29.7%false 70.3%
code not first88.7% true
true 88.7%false 11.3%
code overlap27.2% true
true 27.2%false 72.8%
code sarcasm9.0% true
true 9.0%false 91.0%
code second17.8% true
true 17.8%false 82.2%
code third71.7% true
true 71.7%false 28.3%
code threat5.0% true
true 5.0%false 95.0%
code undirected9.6% true
true 9.6%false 90.4%
7.8
Flesch–Kincaid grade
US school grade level
8.8
Automated readability index
Frequent terms
peopledonliketalibanbidenknowwanttrumpthinkcovidgoingcountryrighttimeafghanistangoodneedgovernmentvaccineyearswayworldletsaiddoesnnewshitbettermoneyvaccinatedgettingpresidentdidnamericastupidstatewonbadgotchildrenhopemaskleftstopchinasureworkthingafghandemocrats
Topic clusters

Topic 0

vaccine
mask
covid
vaccinate
people
school
wear
mandate

Topic 1

taliban
afghanistan
afghan
terrorist
war
leave
isis
military

Topic 2

fuck
stupid
stupidity
dumb
mind
asshole
woman
blame

Topic 3

know
think
good
game
plan
read
yes
choice

Topic 4

pay
loan
rent
landlord
money
property
debt
crypto

Topic 5

biden
trump
impeach
president
administration
incompetent
blame
people

Topic 6

democrats
senate
party
republicans
budget
republican
house
lawmaker

Topic 7

police
cop
gun
shoot
people
unarmed
officer
life

Topic 8

border
illegal
mexico
immigrant
refugee
policy
covid
open

Topic 9

water
change
power
climate
wind
nsw
car
come

Topic 10

trump
idiot
stupid
president
supporters
jail
huh
truly

Topic 11

racist
fascist
white
antifa
liberal
racism
anti
like
Show all 19 topics

Topic 12

china
chinese
economy
money
drug
haha
sure
country

Topic 13

news
newsmax
fake
journalist
twitter
cnn
propaganda
story

Topic 14

kill
love
killing
dead
alive
lose
find
blood

Topic 15

desantis
florida
governor
ron
people
know
treatment
death

Topic 16

kid
child
little
parent
die
sicken
abuse
evil

Topic 17

lie
liar
youtube
channel
hack
fact
corrupt
blatant

Topic 18

god
christ
shall
jesus
sin
dead
lord
raise
Top hashtags
#x200b11
#afghanistan8
#wiki_be_civil6
#14
#24
#wiki_2_4
#33
#covid193
#joebiden3
#taliban3
#trump3
#usa3
#0392
#42
#52
#abcnews2
#america2
#arizona2
#biden2
#bidendisaster2
Top emoji
😂88
🤣67
🤡34
🔥21
👎16
👏15
🙏15
🇸14
👍14
🇺13
😡8
💩7
💪7
📍7
🤔7

Computed over the full corpus.

Record

Catalog key
hot-speech
Authors
Resnick, Paul J.; Hemphill, Libby; Wu, Siqi; Schöpke-Gonzalez, Angela; Kumar, Sagar
Year
2023
Source paper
HOT Speech: Comments from Political News Posts and Videos that were Annotated for Hateful, Offensive, and Toxic Content
DOI / arXiv
10.3886/45fc-9c8f
License
Not stated (ICPSR SOMAR terms of use apply)
Records
3,481
Text corpus
comment text
Languages
en
Collected
2021-08 (2020s)
Tasks
Toxicity detection (multi-label; offensive_hard, toxic_hard, offensive_soft, toxic_soft, composite_offensive, composite_toxic, code_insult, code_threat) inferred, Hate speech detection (multi-label; hateful_hard, hateful_soft, composite_hateful) inferred, Fake news detection (binary; code_misinformation) inferred
Region
Global (inferred: the platform is used worldwide)

Provenance

Originally published at
https://doi.org/10.3886/45fc-9c8f link checked
Hosted copy
Mirrored on echo.directory on 2026-10-09, 1.5 MB across 2 files. Checksums in MANIFEST.json.

How to cite

BibTeX

@misc{echo2026,
  title  = {ECHO: Exploratory Compendium of Humanity Online},
  author = {Switzer, Braden and Zafarani, Reza},
  year   = {2026},
  url    = {https://echo.directory},
  note   = {Syracuse University}
}

@misc{https://doi.org/10.3886/45fc-9c8f,
  doi       = {10.3886/45FC-9C8F},
  url       = {https://www.icpsr.umich.edu/sites/somar/view/studies/300473/versions/V1},
  author    = {Resnick, Paul J. and Hemphill, Libby and Wu, Siqi and Schöpke-Gonzalez, Angela and Kumar, Sagar},
  keywords  = {news media, politics, YouTube, Reddit},
  language  = {en},
  title     = {HOT Speech: Comments from Political News Posts and Videos that were Annotated for Hateful, Offensive, and Toxic Content},
  publisher = {ICPSR - Interuniversity Consortium for Political and Social Research},
  year      = {2026}
}

APA

Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory

Resnick, P. J., Hemphill, L., Wu, S., Schöpke-Gonzalez, A., & Kumar, S. (2023). HOT Speech: Hateful, Offensive, Toxic Speech Dataset [Data set]. https://doi.org/10.3886/45fc-9c8f

MLA

Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.

Resnick, Paul J., et al. HOT Speech: Hateful, Offensive, Toxic Speech Dataset. 2023, doi.org/10.3886/45fc-9c8f.

BibTeX · RIS · CSL-JSON

Similar datasets 10 all with scores →