160

如何找到包含自然语言工具包 (nltk) 使用的所有可能 pos 标签的列表？

4

9 回答 9

172

为了节省一些时间，这是我从一个小型语料库中提取的列表。我不知道它是否完整，但它应该包含来自 upenn_tagset 的大部分（如果不是全部）帮助定义......

CC : 联合，协调

& 'n and both but either et for less minus neither nor or plus so
therefore times v. versus vs. whether yet

CD：数字，基数

mid-1890 nine-thirty forty-two one-tenth ten million 0.5 one forty-
seven 1987 twenty '79 zero two 78-degrees eighty-four IX '60s .025
fifteen 271,124 dozen quintillion DM2,000 ...

DT : 决定者

all an another any both del each either every half la many much nary
neither no some such that the them these this those

EX : 存在的存在

there

IN：介词或连词，从属

astride among upon whether out inside pro despite on by throughout
below within for towards near behind atop around if like until below
next into if beside ...

JJ：形容词或数词，序数

third ill-mannered pre-war regrettable oiled calamitous first separable
ectoplasmic battery-powered participatory fourth still-to-be-named
multilingual multi-disciplinary ...

JJR：形容词，比较级

bleaker braver breezier briefer brighter brisker broader bumper busier
calmer cheaper choosier cleaner clearer closer colder commoner costlier
cozier creamier crunchier cuter ...

JJS：形容词，最高级

calmest cheapest choicest classiest cleanest clearest closest commonest
corniest costliest crassest creepiest crudest cutest darkest deadliest
dearest deepest densest dinkiest ...

LS : 列表项标记

A A. B B. C C. D E F First G H I J K One SP-44001 SP-44002 SP-44005
SP-44007 Second Third Three Two * a b c d first five four one six three
two

MD : 模态辅助

can cannot could couldn't dare may might must need ought shall should
shouldn't will would

NN：名词、普通、单数或质量

common-carrier cabbage knuckle-duster Casino afghan shed thermostat
investment slide humour falloff slick wind hyena override subhumanity
machinist ...

NNP：名词、专有名词、单数

Motown Venneboerger Czestochwa Ranzer Conchita Trumplane Christos
Oceanside Escobar Kreisler Sawyer Cougar Yvette Ervin ODI Darryl CTCA
Shannon A.K.C. Meltex Liverpool ...

NNS：名词，普通，复数

undergraduates scotches bric-a-brac products bodyguards facets coasts
divestitures storehouses designs clubs fragrances averages
subjectivists apprehensions muses factory-jobs ...

PDT : 预定义器

all both half many quite such sure this

POS : 属格标记

' 's

PRP：代词，个人

hers herself him himself hisself it itself me myself one oneself ours
ourselves ownself self she thee theirs them themselves they thou thy us

PRP $：代词，所有格

her his mine my our ours their thy your

RB：副词

occasionally unabatingly maddeningly adventurously professedly
stirringly prominently technologically magisterially predominately
swiftly fiscally pitilessly ...

RBR：副词，比较

further gloomier grander graver greater grimmer harder harsher
healthier heavier higher however larger later leaner lengthier less-
perfectly lesser lonelier longer louder lower more ...

RBS：副词，最高级

best biggest bluntest earliest farthest first furthest hardest
heartiest highest largest least less most nearest second tightest worst

RP : 粒子

aboard about across along apart around aside at away back before behind
by crop down ever fast for forth from go high i.e. in into just later
low more off on open out over per pie raising start teeth that through
under unto up up-pp upon whole with you

TO : "to" 作为介词或不定式标记

to

呃：感叹词

Goodbye Goody Gosh Wow Jeepers Jee-sus Hubba Hey Kee-reist Oops amen
huh howdy uh dammit whammo shucks heck anyways whodunnit honey golly
man baby diddle hush sonuvabitch ...

VB：动词，基本形式

ask assemble assess assign assume atone attention avoid bake balkanize
bank begin behold believe bend benefit bevel beware bless boil bomb
boost brace break bring broil brush build ...

VBD : 动词，过去式

dipped pleaded swiped regummed soaked tidied convened halted registered
cushioned exacted snubbed strode aimed adopted belied figgered
speculated wore appreciated contemplated ...

VBG : 动词、现在分词或动名词

telegraphing stirring focusing angering judging stalling lactating
hankerin' alleging veering capping approaching traveling besieging
encrypting interrupting erasing wincing ...

VBN : 动词，过去分词

multihulled dilapidated aerosolized chaired languished panelized used
experimented flourished imitated reunifed factored condensed sheared
unsettled primed dubbed desired ...

VBP：动词，现在时，不是第三人称单数

predominate wrap resort sue twist spill cure lengthen brush terminate
appear tend stray glisten obtain comprise detest tease attract
emphasize mold postpone sever return wag ...

VBZ：动词，现在时，第三人称单数

bases reconstructs marks mixes displeases seals carps weaves snatches
slumps stretches authorizes smolders pictures emerges stockpiles
seduces fizzes uses bolsters slaps speaks pleads ...

WDT : WH-确定器

that what whatever which whichever

WP : WH-代词

that what whatever whatsoever which who whom whosoever

WRB : Wh-副词

how however whence whenever where whereby whereever wherein whereof why
于 2016-07-08T10:22:13.937 回答
166

这本书有一个说明如何找到标签集的帮助，例如：

nltk.help.upenn_tagset()

其他的可能类似。（注意：也许你首先必须tagsets从下载助手的模型部分下载这个）

于 2013-03-13T15:12:23.387 回答
69

标签集取决于用于训练标注器的语料库。默认标注器nltk.pos_tag()使用Penn Treebank Tag Set。

在 NLTK 2 中，您可以检查哪个标记器是默认标记器，如下所示：

import nltk
nltk.tag._POS_TAGGER
>>> 'taggers/maxent_treebank_pos_tagger/english.pickle'

这意味着它是在 Treebank 语料库上训练的最大熵标注器。

nltk.tag._POS_TAGGER在 NLTK 3 中不再存在，但文档指出现成的标记器仍然使用 Penn Treebank 标记集。

于 2013-03-13T15:33:50.727 回答
40

以下内容可用于访问以缩写为键的字典：

>>> from nltk.data import load
>>> tagdict = load('help/tagsets/upenn_tagset.pickle')
>>> tagdict['NN'][0]
'noun, common, singular or mass'
>>> tagdict.keys()
['PRP$', 'VBG', 'VBD', '``', 'VBN', ',', "''", 'VBP', 'WDT', ...
于 2015-09-01T16:46:21.590 回答
37

参考资料可在官方网站上找到

从那里复制和粘贴：

  • 抄送 | 协调连词 |
  • 光盘 | 基数|
  • DT | 确定者 |
  • 前 | 存在那里|
  • 固件 | 外来词 |
  • 输入 | 介词或从属连词 |
  • JJ | 形容词 |
  • JJR | 形容词，比较级 |
  • JJS | 形容词，最高级 |
  • LS | 列表项标记 |
  • 医学博士 | 模态 |
  • 神经网络 | 名词，单数或质量 |
  • 神经网络 | 名词，复数 |
  • 神经网络 | 专有名词，单数 |
  • 神经网络 | 专有名词，复数 |
  • 光动力技术 | 预定者 |
  • 销售点 | 所有格结尾 |
  • PRP | 人称代词 |
  • PRP$ | 所有格代词 |
  • RB | 副词 |
  • RBR | 副词，比较 |
  • 苏格兰皇家银行 | 副词，最高级 |
  • 反相| 粒子 |
  • SYM | 符号 |
  • 到 | 到|
  • 呃 | 感叹词 |
  • VB | 动词，基本形式 |
  • VBD | 动词，过去式 |
  • VBG | 动词、动名词或现在分词 |
  • 宽带网络 | 动词，过去分词 |
  • VBP | 动词，非第三人称单数现在时 |
  • VBZ | 动词，第三人称单数现在时 |
  • 看门狗| Wh-确定器 |
  • 可湿性粉剂 | 代词 |
  • WP$ | 所有格 wh 代词 |
  • 水利局 | Wh-副词 |
于 2016-12-14T18:53:29.937 回答
3 
['LS', 'TO', 'VBN', "''", 'WP', 'UH', 'VBG', 'JJ', 'VBZ', '--', 'VBP', 'NN', 'DT', 'PRP', ':', 'WP$', 'NNPS', 'PRP$', 'WDT', '(', ')', '.', ',', '``', '$', 'RB', 'RBR', 'RBS', 'VBD', 'IN', 'FW', 'RP', 'JJR', 'JJS', 'PDT', 'MD', 'VB', 'WRB', 'NNP', 'EX', 'NNS', 'SYM', 'CC', 'CD', 'POS']

基于 Doug Shore 的方法，但使其更易于复制粘贴

于 2020-02-20T04:28:37.287 回答
1

您可以在此处下载列表：ftp: //ftp.cis.upenn.edu/pub/treebank/doc/tagguide.ps.gz。它包括令人困惑的词性、大小写和其他约定。此外，维基百科有一个与此类似的有趣部分。部分：使用的词性标签。

于 2017-09-28T19:28:40.370 回答
0

只需逐字运行。

import nltk
nltk.download('tagsets')
nltk.help.upenn_tagset()

nltk.tag._POS_TAGGER不会工作。它将给出AttributeError: module 'nltk.tag' has no attribute '_POS_TAGGER'。它不再在 NLTK 3 中可用。

于 2020-01-16T19:00:59.487 回答
0

在 python 中运行以下代码以获取有关所有 pos 标签的信息。

import nltk
nltk.help.upenn_tagset()
于 2021-07-26T20:14:44.367 回答