Edit model card

cnn_dailymail_6789_200000_100000_v1_150topics_train

This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

Usage

To use this model, please install BERTopic:

pip install -U bertopic

You can use the model as follows:

from bertopic import BERTopic
topic_model = BERTopic.load("KingKazma/cnn_dailymail_6789_200000_100000_v1_150topics_train")

topic_model.get_topic_info()

Topic overview

  • Number of topics: 150
  • Number of training documents: 200000
Click here for an overview of all topics.
Topic ID Topic Keywords Topic Frequency Label
-1 said - one - year - people - also 5 -1_said_one_year_people
0 league - player - club - cup - goal 104194 0_league_player_club_cup
1 police - said - told - murder - court 19383 1_police_said_told_murder
2 security - us - military - government - said 14660 2_security_us_military_government
3 race - win - champion - open - murray 6315 3_race_win_champion_open
4 nfl - fight - game - team - player 4973 4_nfl_fight_game_team
5 dog - animal - cat - zoo - pet 2700 5_dog_animal_cat_zoo
6 obama - republican - president - republicans - romney 2115 6_obama_republican_president_republicans
7 car - driver - driving - vehicle - road 2068 7_car_driver_driving_vehicle
8 flight - plane - passenger - airline - airport 2016 8_flight_plane_passenger_airline
9 nhs - bank - patient - eu - cent 1995 9_nhs_bank_patient_eu
10 show - film - cosby - movie - actor 1914 10_show_film_cosby_movie
11 weather - storm - snow - rain - water 1874 11_weather_storm_snow_rain
12 shark - whale - ship - oil - sea 1577 12_shark_whale_ship_oil
13 fashion - art - painting - artist - collection 1513 13_fashion_art_painting_artist
14 war - soldier - army - scotland - british 1485 14_war_soldier_army_scotland
15 space - earth - mars - planet - nasa 1300 15_space_earth_mars_planet
16 ebola - virus - disease - health - outbreak 1212 16_ebola_virus_disease_health
17 russian - russia - ukraine - putin - ukrainian 1193 17_russian_russia_ukraine_putin
18 haiti - cuba - chavez - cuban - president 1173 18_haiti_cuba_chavez_cuban
19 korea - north - korean - kim - south 1120 19_korea_north_korean_kim
20 china - chinese - chinas - hong - beijing 928 20_china_chinese_chinas_hong
21 property - house - price - home - estate 909 21_property_house_price_home
22 mandela - africa - african - boko - haram 884 22_mandela_africa_african_boko
23 bali - thai - thailand - philippines - bangkok 866 23_bali_thai_thailand_philippines
24 apple - iphone - device - apples - ipad 862 24_apple_iphone_device_apples
25 prince - royal - duchess - queen - princess 827 25_prince_royal_duchess_queen
26 fire - blaze - firefighter - smoke - flame 769 26_fire_blaze_firefighter_smoke
27 mexico - mexican - cartel - border - drug 746 27_mexico_mexican_cartel_border
28 food - sugar - diet - calorie - chocolate 739 28_food_sugar_diet_calorie
29 school - education - pupil - schools - teacher 725 29_school_education_pupil_schools
30 india - delhi - indian - indias - singh 558 30_india_delhi_indian_indias
31 facebook - user - app - social - twitter 537 31_facebook_user_app_social
32 album - music - song - bieber - band 536 32_album_music_song_bieber
33 pope - vatican - francis - church - cardinal 534 33_pope_vatican_francis_church
34 name - child - boo - baby - wedding 525 34_name_child_boo_baby
35 marijuana - smoking - tobacco - drug - cannabis 520 35_marijuana_smoking_tobacco_drug
36 sandusky - penn - student - paterno - fraternity 505 36_sandusky_penn_student_paterno
37 internet - computer - hacker - online - user 490 37_internet_computer_hacker_online
38 weight - size - diet - stone - fat 466 38_weight_size_diet_stone
39 book - novel - author - shades - potter 398 39_book_novel_author_shades
40 japan - japanese - china - nuclear - reactor 397 40_japan_japanese_china_nuclear
41 marriage - samesex - gay - state - court 396 41_marriage_samesex_gay_state
42 ancient - archaeologist - tomb - roman - site 384 42_ancient_archaeologist_tomb_roman
43 cancer - patient - skin - breast - treatment 381 43_cancer_patient_skin_breast
44 mayor - ford - weiner - occupy - blasio 374 44_mayor_ford_weiner_occupy
45 energy - gas - price - fracking - oil 361 45_energy_gas_price_fracking
46 saatchi - madoff - ecclestone - lawson - nigella 318 46_saatchi_madoff_ecclestone_lawson
47 abortion - baby - ivf - breastfeeding - woman 312 47_abortion_baby_ivf_breastfeeding
48 christmas - shopper - shopping - tree - store 309 48_christmas_shopper_shopping_tree
49 nazi - hitler - jews - camp - auschwitz 308 49_nazi_hitler_jews_camp
50 climate - ice - warming - change - carbon 275 50_climate_ice_warming_change
51 berlusconi - italian - roma - berlusconis - mafia 263 51_berlusconi_italian_roma_berlusconis
52 rail - train - hs2 - london - passenger 260 52_rail_train_hs2_london
53 transcript - student - news - todays - cnn 256 53_transcript_student_news_todays
54 lottery - ticket - jackpot - winning - powerball 248 54_lottery_ticket_jackpot_winning
55 abbott - minister - australian - asylum - australia 239 55_abbott_minister_australian_asylum
56 fossil - specie - neanderthals - dinosaur - human 237 56_fossil_specie_neanderthals_dinosaur
57 kasem - hospital - euthanasia - ashya - kerri 224 57_kasem_hospital_euthanasia_ashya
58 hotel - beach - island - resort - city 223 58_hotel_beach_island_resort
59 robot - 3d - printer - toy - technology 214 59_robot_3d_printer_toy
60 jackson - jacksons - aeg - murray - michael 209 60_jackson_jacksons_aeg_murray
61 brain - autism - sleep - alzheimers - adhd 208 61_brain_autism_sleep_alzheimers
62 food - meat - product - cull - beef 204 62_food_meat_product_cull
63 game - console - xbox - gaming - playstation 201 63_game_console_xbox_gaming
64 hollande - sarkozy - trierweiler - french - francois 196 64_hollande_sarkozy_trierweiler_french
65 alcohol - wine - drinking - beer - drink 180 65_alcohol_wine_drinking_beer
66 woman - childcare - child - benefit - work 174 66_woman_childcare_child_benefit
67 tower - building - 911 - memorial - york 172 67_tower_building_911_memorial
68 epstein - prince - roberts - andrew - sex 162 68_epstein_prince_roberts_andrew
69 wars - film - star - movie - hobbit 152 69_wars_film_star_movie
70 spanish - gibraltar - spain - eta - basque 143 70_spanish_gibraltar_spain_eta
71 jobs - billion - apple - wealth - gates 139 71_jobs_billion_apple_wealth
72 waste - water - bag - plastic - toilet 137 72_waste_water_bag_plastic
73 sotomayor - court - justice - supreme - ginsburg 131 73_sotomayor_court_justice_supreme
74 falklands - clarkson - argentina - falkland - islands 130 74_falklands_clarkson_argentina_falkland
75 miner - mine - factory - garment - bangladesh 129 75_miner_mine_factory_garment
76 fgm - circumcision - hpv - genital - mutilation 127 76_fgm_circumcision_hpv_genital
77 pollution - allergy - air - smog - pollen 115 77_pollution_allergy_air_smog
78 bosnian - mladic - serb - srebrenica - war 113 78_bosnian_mladic_serb_srebrenica
79 eye - ear - hand - surgery - implant 100 79_eye_ear_hand_surgery
80 vitamin - statin - caffeine - risk - heart 98 80_vitamin_statin_caffeine_risk
81 jeffs - flds - utah - church - polygamy 95 81_jeffs_flds_utah_church
82 travolta - scientology - polanski - church - cruise 93 82_travolta_scientology_polanski_church
83 toyota - recall - gm - vehicle - ignition 92 83_toyota_recall_gm_vehicle
84 miss - pageant - beauty - competition - universe 89 84_miss_pageant_beauty_competition
85 kyle - routh - sniper - littlefield - kyles 85 85_kyle_routh_sniper_littlefield
86 veil - muslim - niqab - ban - burka 81 86_veil_muslim_niqab_ban
87 hair - amish - beard - mullet - moustache 79 87_hair_amish_beard_mullet
88 cruise - amoeba - norovirus - ill - illness 78 88_cruise_amoeba_norovirus_ill
89 ring - diamond - jewelry - jewellery - heist 76 89_ring_diamond_jewelry_jewellery
90 corruption - country - population - index - happiness 76 90_corruption_country_population_index
91 clown - ghost - haunted - exorcism - ghostly 73 91_clown_ghost_haunted_exorcism
92 bobbi - kristina - houston - whitney - gordon 68 92_bobbi_kristina_houston_whitney
93 dubai - hajj - pilgrim - mecca - mme 68 93_dubai_hajj_pilgrim_mecca
94 balloon - heene - trappe - falcon - circus 66 94_balloon_heene_trappe_falcon
95 park - ski - canyon - national - cave 64 95_park_ski_canyon_national
96 expedition - pole - antarctic - ice - ship 64 96_expedition_pole_antarctic_ice
97 hockey - nhl - ice - game - kings 63 97_hockey_nhl_ice_game
98 bull - gored - pamplona - bullfighting - bullfight 62 98_bull_gored_pamplona_bullfighting
99 king - luther - civil - lincoln - kings 61 99_king_luther_civil_lincoln
100 bucket - bowl - als - challenge - puppy 60 100_bucket_bowl_als_challenge
101 tibetan - tibet - dalai - tibetans - lama 60 101_tibetan_tibet_dalai_tibetans
102 mushroom - ash - tree - pumpkin - plant 59 102_mushroom_ash_tree_pumpkin
103 ballet - filin - bolshoi - dancer - dmitrichenko 50 103_ballet_filin_bolshoi_dancer
104 gm - crop - food - plant - genetically 50 104_gm_crop_food_plant
105 disney - disneyland - walt - park - frozen 45 105_disney_disneyland_walt_park
106 nuclear - davos - treaty - obama - weapon 45 106_nuclear_davos_treaty_obama
107 bitcoin - currency - coin - bitcoins - note 43 107_bitcoin_currency_coin_bitcoins
108 gun - laser - 3d - printer - weapon 42 108_gun_laser_3d_printer
109 teeth - dentist - dental - tooth - denture 40 109_teeth_dentist_dental_tooth
110 fragrance - scent - perfume - smell - bottle 39 110_fragrance_scent_perfume_smell
111 holiday - apd - tax - flight - thanksgiving 38 111_holiday_apd_tax_flight
112 oldest - age - imich - okawa - birthday 36 112_oldest_age_imich_okawa
113 plate - search - camera - police - database 36 113_plate_search_camera_police
114 kitty - hello - hong - kong - sanrio 32 114_kitty_hello_hong_kong
115 nobel - prize - peace - award - committee 31 115_nobel_prize_peace_award
116 violin - orchestra - stradivarius - instrument - stradivari 31 116_violin_orchestra_stradivarius_instrument
117 dna - graphene - cell - genome - synthetic 30 117_dna_graphene_cell_genome
118 teresa - giudice - gabor - anhalt - zsa 29 118_teresa_giudice_gabor_anhalt
119 gandolfini - sopranos - gandolfinis - soprano - actor 27 119_gandolfini_sopranos_gandolfinis_soprano
120 turing - bletchley - enigma - turings - code 26 120_turing_bletchley_enigma_turings
121 nelson - napoleon - battle - trafalgar - hms 26 121_nelson_napoleon_battle_trafalgar
122 redskins - name - native - snyder - mascot 25 122_redskins_name_native_snyder
123 marilyn - fawcett - monroe - oneal - farrah 25 123_marilyn_fawcett_monroe_oneal
124 helmet - virtual - oculus - headset - vr 25 124_helmet_virtual_oculus_headset
125 eurovision - contest - song - conchita - azerbaijan 23 125_eurovision_contest_song_conchita
126 flag - union - national - flags - st 21 126_flag_union_national_flags
127 clooney - amal - alamuddin - chao - george 20 127_clooney_amal_alamuddin_chao
128 python - monty - cleese - pythons - idle 19 128_python_monty_cleese_pythons
129 accent - dialect - language - cromarty - sound 19 129_accent_dialect_language_cromarty
130 mayan - apocalypse - maya - calendar - end 18 130_mayan_apocalypse_maya_calendar
131 evolution - creationism - scientific - intelligent - theory 18 131_evolution_creationism_scientific_intelligent
132 prabowo - indonesia - jakarta - widodo - jokowi 17 132_prabowo_indonesia_jakarta_widodo
133 favourite - fan - top - yougov - five 15 133_favourite_fan_top_yougov
134 detroit - poverty - city - census - rate 15 134_detroit_poverty_city_census
135 arafat - arafats - polonium - palestinian - polonium210 15 135_arafat_arafats_polonium_palestinian
136 dmlaterbundle - twittervia - lanza - zann - ilfracombe 13 136_dmlaterbundle_twittervia_lanza_zann
137 clock - time - hour - daylight - westworth 13 137_clock_time_hour_daylight
138 ikea - furniture - ikeas - kamprad - fsc 12 138_ikea_furniture_ikeas_kamprad
139 phone - radiation - mobile - cancer - cell 10 139_phone_radiation_mobile_cancer
140 dangi - guinness - kulkarni - tall - mruga 9 140_dangi_guinness_kulkarni_tall
141 vick - vicks - nfl - falcons - virginia 9 141_vick_vicks_nfl_falcons
142 bulb - light - leds - paddle - bulbs 8 142_bulb_light_leds_paddle
143 wormhole - photon - teleportation - relativity - warp 7 143_wormhole_photon_teleportation_relativity
144 bundy - cliven - bundys - cattle - land 6 144_bundy_cliven_bundys_cattle
145 valentines - cuddle - romantic - hess - cuddling 6 145_valentines_cuddle_romantic_hess
146 port - cairo - almasry - egypt - ministry 6 146_port_cairo_almasry_egypt
147 sanford - sanfords - jenny - carolina - mark 5 147_sanford_sanfords_jenny_carolina
148 deeds - gus - creigh - virginia - son 5 148_deeds_gus_creigh_virginia

Training hyperparameters

  • calculate_probabilities: False
  • language: english
  • low_memory: False
  • min_topic_size: 10
  • n_gram_range: (1, 1)
  • nr_topics: 150
  • seed_topic_list: None
  • top_n_words: 10
  • verbose: False

Framework versions

  • Numpy: 1.23.5
  • HDBSCAN: 0.8.33
  • UMAP: 0.5.3
  • Pandas: 1.5.3
  • Scikit-Learn: 1.2.2
  • Sentence-transformers: 2.2.2
  • Transformers: 4.31.0
  • Numba: 0.57.1
  • Plotly: 5.15.0
  • Python: 3.10.12
Downloads last month
2