tokenizer.fr-exceptions.txt Maven / Gradle / Ivy
Go to download
Show more of this group Show more artifacts with this name
Show all versions of ixa-pipe-ml Show documentation
Show all versions of ixa-pipe-ml Show documentation
IXA pipes machine learning component (ixa2.si.ehu.es/ixa-pipes).
#any single upper case letter followed by a period is not a sentence ender
#usually upper case letters are initials in a name
#no French words end in single lower-case letters, so we throw those in too?
A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
y
z
# Period-final abbreviation list for French
A.C.N
A.M
art
ann
apr
av
auj
lib
B.P
boul
ca
c.-à-d
cf
ch.-l
chap
contr
C.P.I
C.Q.F.D
C.N
C.N.S
C.S
dir
éd
e.g
env
al
etc
E.V
ex
fasc
fém
fig
fr
hab
ibid
id
i.e
inf
LL.AA
LL.AA.II
LL.AA.RR
LL.AA.SS
L.D
LL.EE
LL.MM
LL.MM.II.RR
loc.cit
masc
MM
ms
N.B
N.D.A
N.D.L.R
N.D.T
n/réf
NN.SS
N.S
N.D
N.P.A.I
p.c.c
pl
pp
p.ex
p.j
P.S
R.A.S
R.-V
R.P
R.I.P
SS
S.S
S.A
S.A.I
S.A.R
S.A.S
S.E
sec
sect
sing
S.M
S.M.I.R
sq
sqq
suiv
sup
suppl
tél
T.S.V.P
vb
vol
vs
X.O
Z.I
#These are often followed by upper-case names, but do not indicate sentence breaks
Adj
Adm
Adv
Asst
Assn
Assoc
Bart
Bldg
Blvd
Brig
Bros
Capt
Cmdr
Col
Comdr
Con
Corp
Cpl
Dep
Dept
DR
Dr
Drs
Ens
Esq
ext
Fac
Gen
Gov
Hon
Hr
Hosp
Inc
Insp
Intl
Jr
Lt
Lieut
Ltd
MM
Msr
Mgr
MR
MRS
MS
Maj
Messrs
Mlle
Mme
Mr
Mrs
Ms
Msgr
Op
Ord
Pfc
Plc
Ph
Prof
Pvt
Rd
Rep
Reps
Res
Rev
Rt
Sen
Sens
Sfc
Sgt
Sys
Sr
St
sq
Supt
Surg
tel
Univ
# dates
Jan
Feb
Mar
Apr
Jun
Jul
Aug
Sept
Oct
Nov
Dec
Mon
Tue
Wed
Thur
Fri
Sat
#states
Ala
Ariz
[A]rk
Calif
Colo
Conn
Dak
Del
Fla
Ga
[I]ll
Ind
Kans?
Ky
La
[M]ass
Md
Mich
Minn
[M]iss
Mo
Mont
Neb
Nev
Okla
[O]re
Pa
Penn
Tenn
Tex
Va
Vt
[W]ash
Wisc
Wyo
janv
févr
mars
avril
juin
juil
août
déc
lun
mer
jeu
ven
sam
dim