スライド 1

Structural Phrase Alignment
Based on Consistency Criteria
Core Steps of Alignment
Flow of Our EBMT System
• Searching Correspondence Candidates
Translation Examples
Input
交差 (cross)
交差点に入る時
私の信号は青でした。
交差
(cross)
点に
(point)
at me
my
突然 (suddenly)
traffic
at the intersection
The light
家に
(house)
to remove
入る
(enter)
時 (when)
二百十六万 → 2,160,000 ← 2.16 million
entering
a house
私の (my)
• Numeral normalization
when
entering
私の (my)
ローズワイン → rosuwain ⇔ rose wine (similarity:0.78)
新宿 → shinjuku ⇔ shinjuku (similarity:1.0)
was green
when
脱ぐ (put off)
信号は
(signal)
青
(blue)
でした。
(was)
• Bilingual dictionaries
• Transliteration (Katakana words, NEs)
from the side
飛び出して来たのです。
(rush out)
入る
(enter)
時
(when)
– Fine alignment is efficient in translation
– Search candidates as much as possible using variety of linguistic information
came
点で、(point)
Toshiaki Nakazawa, Kun Yu, Sadao Kurohashi
(Graduate School of Informatics, Kyoto University)
{nakazawa, kunyu}@nlp.kuee.kyoto-u.ac.jp
[email protected]
• Japanese flexible matching (Odani et. al. 2007)
• Substring co-occurrence measure (Cromieres 2006)
the intersection
my
サイン (signal)
signature
信号は
(signal)
青
(blue)
でした。
(was)
Language Models
traffic
Output
My traffic light was
green when entering
the intersection.
The light
was green
• Selecting Correspondence Candidates
– More candidates derive more ambiguities and improper alignments
– Necessity of robust alignment method which can align parallel sentences
consistently by selecting the adequate candidates set
Selecting Correspondence Candidates
Using Consistency Score and Dependency Type
Ambiguities!
日本で
1
1
csd J , d E  

dJ dE
you
(in Japan)
保険
Near!
will have to file
(insurance)
会社に対して
insurance
Far!
(to company)
保険
Far!
an claim
(insurance)
請求の
1/1+1/2=1.5
insurance
(claim)
申し立てが
baseline
with the office
Near!
(instance)
可能ですよ
(you can)
Improper
alignments!
in Japan
How to reflect the inconsistency?
Japanese
arg max csd J (ai , a j ), d E (ai , a j )
alignment
i
j
J-Side Distance E-Side Distance
Consistency Score
predicate: level C
6
S / SBAR / SQ …
5
predicate: level B+/B
5
VP / WHADVP
4
predicate: level B-/A
4
WHADJP
case no / rentai
2
Inside clause
1
ADVP / ADJP
NP / PP / INTJ
Others
3
QP / PRT / PRN
predicate: level A-
Frequency
(log)
3
Others
1
Dependency Type Distance
３
NP you
３
デ格日本で
１
文節内
Dist of J-Side
Distribution of the distance of alignment
pairs in hand-annotated data (Mainichi
newspaper 40K sentence pairs)
[Uchimoto04]
保険
Score
[renyou]
１
[inside clause] 文節内
２
ノ格
will have to file
１
NN
E-Side
Distance
[case “ga”] (instance)
可能ですよ
J-Side Distance
Experimental Result
１
NN
(claim)
Pair 2:
(Ds, Dt) = (1, 7)
Negative Score
(you can)
insurance
３
PP with the office
３
PP in Japan
Quality of Other Language Pairs
500 test sentences from Mainichi newspaper parallel corpus
Bilingual dictionary: KENKYUSYA J-E/J-E 500K entries
Evaluation criteria: Precision / Recall / F-measure
Character-base for Japanese, word-base for English
Rec
64.32
66.90
69.14
71.31
33.15
89.80
保険
請求の
３
ガ格申し立てが
insurance
３
NP an claim
(insurance)
[case “no”]
Pre
77.47
80.30
80.77
82.48
60.19
95.58
Pair 1:
(Ds, Dt) = (1, 1)
Positive Score
(to company)
Consistency Score Function
* Using 300K newspaper domain bi-sentences for training
(insurance)
[inside clause]
３
連用会社に対して
“Near-Near” pair → Positive Score
“Far-Far” pair → ０
“Near-Far” pair → Negative Score
Baseline
+Consistency Score
Proposed(+CS,+DpndType)
Filtering (80%)
Moses (SMT Toolkit)*
Manual (upper bound)
(in Japan)
[case “de”]
Dist of E-Side
•
•
•
•
English
F
70.29
72.99
74.51
76.49
42.75
92.60
HLT-NAACL 2003
ACL 2005
（Gildea, 2003）
GIZA++
EnglishFrench
5.71
15.89
EnglishRomanian
28.86
26.55
27.19
EnglishKorean
32
35
(AER)
Conclusion
•
•
•
•
Proposed a new phrase alignment method using consistency criteria.
Enough alignment accuracy compared to other language pairs.
We need to acquire the parameters automatically by machine learning.
We are planning to evolve the framework which revises the parse result.
(There is a translation demos in exhibition corner by NICT which is using our system!)

Download Report