ipe-tok.1.8.6.source-code.it-nonbreaker.txt Maven / Gradle / Ivy

Go to download

Show more of this group Show more artifacts with this name
Show all versions of ixa-pipe-tok Show documentation

The ixa pipes tokenizer (ixa2.si.ehu.es/ixa-pipes)

The newest version!

#any single upper case letter  followed by a period is not a sentence ender (excluding I occasionally, but we leave it in)
#usually upper case letters are initials in a name
A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z

#List of titles. These are often followed by upper-case names, but do not indicate sentence breaks
Adj
Adm
Adv
Amn 
Arch 
Asst
Avv
Bart
Bcc
Bldg
Brig
Bros
C.A.P
C.P
Capt
Cc
Cmdr
Co
Col
Comdr
Con
Corp
Cpl
DR
Dott
Dr
Drs
Egr
Ens
Gen
Geom
Gov
Hon
Hosp
Hr
Id
Ing
Insp
Lt
MM
MR
MRS
MS
Maj
Messrs
Mlle
Mme
Mo
Mons
Mr
Mrs
Ms
Msgr
N.B
Op
Ord
P.S
P.T
Pfc
Ph
Prof
Pvt
RP
RSVP
Rag
Rep
Reps
Res
Rev
Rif
Rt
S.A
S.B.F
S.P.M
S.p.A
S.r.l
Sen
Sens
Sfc
Sgt
Sig
Sigg
Soc
Spett
Sr
St
Supt
Surg
V.P

# other
a.c
acc
all
banc
c.a
c.c.p
c.m
c.p
c.s
c.v
corr
dott
e.p.c
ecc
es
fatt
gg
int
lett
ogg
on
p.c
p.c.c
p.es
p.f
p.r
p.v
post
pp
racc
ric
s.n.c
seg
sgg
ss
tel
u.s
v.r
v.s

#misc - odd period-ending items that NEVER indicate breaks (p.m. does NOT fall into this category - it sometimes ends a sentence)
v
vs
i.e
rev
e.g

#sometimes followed by a number but break anyway
Nos
Nr

#These are often followed by upper-case names, but do not indicate sentence breaks
Adj
Adm
Adv
Asst
Assn
Assoc
Bart
Bldg
Blvd
Brig
Bros
Capt
Cmdr
Col
Comdr
Con
Corp
Cpl
Dep
Dept
DR
Dr
Drs
Ens
Esq
ext
Fac
Gen
Gov
Hon
Hr
Hosp
Inc
Insp
Intl
Jr
Lt
Lieut
Ltd
MM
MR
MRS
MS
Maj
Messrs
Mlle
Mme
Mr
Mrs
Ms
Msgr
Op
Ord
Pfc
Plc
Ph
Prof
Pvt
Rd
Rep
Reps
Res
Rev
Rt
Sen
Sens
Sfc
Sgt
Sys
Sr
St
sq
Supt
Surg
tel
Univ

#dates
genn
febbr
magg
giugno
luglio
sett
ott