WMT 2011


Sixth Workshop on

Statistical Machine Translation


Proceedings of the Workshop

July 30–31, 2011


Conference program


Table of Contents


A Grain of Salt for the WMT Manual Evaluation

Ondřej Bojar, Miloš Ercegovčević, Martin Popel and Omar Zaidan . . .  1

A Lightweight Evaluation Framework for Machine Translation Reordering

David Talbot, Hideto Kazawa, Hiroshi Ichikawa, Jason Katz-Brown, Masakazu Seno and Franz Och . . .  12

Findings of the 2011 Workshop on Statistical Machine Translation

Chris Callison-Burch, Philipp Koehn, Christof Monz and Omar Zaidan . . .  22

Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features

Eleftherios Avramidis, Maja Popović, David Vilar and Aljoscha Burchardt . . . 65

AMBER: A Modified BLEU, Enhanced Ranking Metric

Boxing Chen and Roland Kuhn . . . 71

TESLA at WMT 2011: Translation Evaluation and Tunable Metric

Daniel Dahlmeier, Chang Liu and Hwee Tou Ng . . . 78

Meteor 1.3: Automatic Metric for Reliable Optimization and Evaluation of Machine Translation Systems

Michael Denkowski and Alon Lavie . . .  85

Approximating a Deep-Syntactic Metric for MT Evaluation and Tuning

Matouš Macháček and Ondřej Bojar . . .  92

Evaluation without references: IBM1 scores as evaluation metrics

Maja Popović, David Vilar, Eleftherios Avramidis and Aljoscha Burchardt . . . 99

Morphemes and POS tags for n-gram based evaluation metrics

Maja Popović . . . 104

E-rating Machine Translation

Kristen Parton, Joel Tetreault, Nitin Madnani and Martin Chodorow . . .  108

TINE: A Metric to Assess MT Adequacy

Miguel Rios, Wilker Aziz and Lucia Specia . . . 116

Regression and Ranking based Optimisation for Sentence Level MT Evaluation

Xingyi Song and Trevor Cohn . . . 123

MAISE: A Flexible, Configurable, Extensible Open Source Package for Mass AI System Evaluation

Omar Zaidan . . .130

MANY improvements for WMT’11

Loïc Barrault. . . . 135

The UPV-PRHLT combination system for WMT 2011

Jesús González-Rubio and Francisco Casacuberta. . . .140

CMU System Combination in WMT 2011

Kenneth Heafield and Alon Lavie . . .145

The RWTH System Combination System for WMT 2011

Gregor Leusch, Markus Freitag and Hermann Ney . . .152

Expected BLEU Training for Graphs: BBN System Description for WMT11 System Combination Task

Antti-Veikko Rosti, Bing Zhang, Spyros Matsoukas and Richard Schwartz . . . 159

The UZH System Combination System for WMT 2011

Rico Sennrich . . .166

Description of the JHU System Combination Scheme for WMT 2011

Daguang Xu, Yuan Cao and Damianos Karakos . . . 171

Multiple-stream Language Models for Statistical Machine Translation

Abby Levenberg, Miles Osborne and David Matthews. . . 177

KenLM: Faster and Smaller Language Model Queries

Kenneth Heafield . . .187

Wider Context by Using Bilingual Language Models in Machine Translation

Jan Niehues, Teresa Herrmann, Stephan Vogel and Alex Waibel . . .198

A Minimally Supervised Approach for Detecting and Ranking Document Translation Pairs

Kriste Krstovski and David A. Smith . . . 207

Agreement Constraints for Statistical Machine Translation into German

Philip Williams and Philipp Koehn . . . 217

Fuzzy Syntactic Reordering for Phrase-based Statistical Machine Translation

Jacob Andreas, Nizar Habash and Owen Rambow . . . 227

Filtering Antonymous, Trend-Contrasting, and Polarity-Dissimilar Distributional Paraphrases for Improving Statistical Machine Translation

Yuval Marton, Ahmed El Kholy and Nizar Habash . . . 237

Productive Generation of Compound Words in Statistical Machine Translation

Sara Stymne and Nicola Cancedda . . . 250

SampleRank Training for Phrase-Based Machine Translation

Barry Haddow, Abhishek Arun and Philipp Koehn . . . 261

Instance Selection for Machine Translation using Feature Decay Algorithms

Ergun Biçici and Deniz Yuret . . . 272

Investigations on Translation Model Adaptation Using Monolingual Data

Patrik Lambert, Holger Schwenk, Christophe Servan and Sadaf Abdul-Rauf . . . 284

Topic Adaptation for Lecture Translation through Bilingual Latent Semantic Models

Nick Ruiz and Marcello Federico . . . 294

Personal Translator at WMT2011

Vera Aleksić and Gregor Thurmair . . . 303


Alexandre Allauzen, Hélène Bonneau-Maynard, Hai-Son Le, Aurélien Max, Guillaume Wisniewski,

François Yvon, Gilles Adda, Josep Maria Crego, Adrien Lardilleux, Thomas Lavergne and

Artem Sokolov. . . 309

Shallow Semantic Trees for SMT

Wilker Aziz, Miguel Rios and Lucia Specia . . .316

RegMT System for Machine Translation, System Combination, and Evaluation

Ergun Biçici and Deniz Yuret . . . 323

Improving Translation Model by Monolingual Data

Ondřej Bojar and Aleš Tamchyna . . .330

The CMU-ARK German-English Translation System

Chris Dyer, Kevin Gimpel, Jonathan H. Clark and Noah A. Smith . . .337

Noisy SMS Machine Translation in Low-Density Languages

Vladimir Eidelman, Kristy Hollingshead and Philip Resnik . . . 344

Stochastic Parse Tree Selection for an Existing RBMT System

Christian Federmann and Sabine Hunsicker . . . 351

Joint WMT Submission of the QUAERO Project

Markus Freitag, Gregor Leusch, Joern Wuebker, Stephan Peitz, Hermann Ney, Teresa Herrmann,

Jan Niehues, Alex Waibel, Alexandre Allauzen, Gilles Adda, Josep Maria Crego, Bianka Buschbeck,

Tonio Wandmacher and Jean Senellart . . . 358

CMU Syntax-Based Machine Translation at WMT 2011

Greg Hanneman and Alon Lavie . . . 365

The Uppsala-FBK systems at WMT 2011

Christian Hardmeier, Jörg Tiedemann, Markus Saers, Marcello Federico and Mathur Prashant…372

The Karlsruhe Institute of Technology Translation Systems for the WMT 2011

Teresa Herrmann, Mohammed Mediani, Jan Niehues and Alex Waibel . . . 379

CMU Haitian Creole-English Translation System for WMT 2011

Sanjika Hewavitharana, Nguyen Bach, Qin Gao, Vamshi Ambati and Stephan Vogel . . . 386

Experiments with word alignment, normalization and clause reordering for SMT between English and German

Maria Holmqvist, Sara Stymne and Lars Ahrenberg . . . 393

The Value of Monolingual Crowdsourcing in a Real-World Translation Scenario: Simulation using Haitian Creole Emergency SMS Messages

Chang Hu, Philip Resnik, Yakov Kronrod, Vladimir Eidelman, Olivia Buzek and Benjamin B.Bederson . . . 399

The RWTH Aachen Machine Translation System for WMT 2011

Matthias Huck, Joern Wuebker, Christoph Schmidt, Markus Freitag, Stephan Peitz, Daniel Stein,

Arnaud Dagnelies, Saab Mansour, Gregor Leusch and Hermann Ney . . . 405

ILLC-UvA translation system for EMNLP-WMT 2011

Maxim Khalilov and Khalil Sima’an . . . 413

UPM system for the translation task

Véronique López-Ludeña and Rubén San-Segundo . . .420

Two-step translation with grammatical post-processing

David Mareček, Rudolf Rosa, Petra Galuščáková and Ondřej Bojar . . .426

Influence of Parser Choice on Dependency-Based MT

Martin Popel, David Mareček, Nathan Green and Zdeněk Žabokrtský . . .433

The LIGA (LIG/LIA) Machine Translation System for WMT 2011

Marion Potet, Raphaël Rubino, Benjamin Lecouteux, Stéphane Huet, Laurent Besacier, Hervé

Blanchon and Fabrice Lefèvre . . . 440

Factored Translation with Unsupervised Word Clusters

Christian Rishøj and Anders Søgaard . . .447

The BM-I2R Haitian-Cr´eole-to-English translation system description for the WMT 2011 evaluation campaign

Marta R. Costa-jussà and Rafael E. Banchs . . . 452

The Universitat d’Alacant hybrid machine translation system for WMT 2011

V´ıctor M. Sánchez-Cartagena, Felipe Sánchez-Martínez and Juan Antonio Pérez-Ortiz . . . 457

LIUM’s SMT Machine Translation Systems for WMT 2011

Holger Schwenk, Patrik Lambert, Loïc Barrault, Christophe Servan, Sadaf Abdul-Rauf, Haithem Afli and Kashif Shah . . . 464

Spell Checking Techniques for Replacement of Unknown Words and Data Cleaning for Haitian Creole SMS Translation

Sara Stymne . . . 470

Joshua 3.0: Syntax-based Machine Translation with the Thrax Grammar Extractor

Jonathan Weese, Juri Ganitkevitch, Chris Callison-Burch, Matt Post and Adam Lopez . . . 478

DFKI Hybrid Machine Translation System for WMT 2011 - On the Integration of SMT and RBMT

Jia Xu, Hans Uszkoreit, Casey Kennington, David Vilar and Xiaojun Zhang . . .485

CEU-UPV English-Spanish system for WMT11

Francisco Zamora-Martinez and Maria Jose Castro-Bleda . . . 490

Hierarchical Phrase-Based MT at the Charles University for the WMT 2011 Shared Task

Daniel Zeman . . . 496

Crisis MT: Developing A Cookbook for MT in Crisis Situations

William Lewis, Robert Munro and Stephan Vogel . . . 501

Generative Models of Monolingual and Bilingual Gappy Patterns

Kevin Gimpel and Noah A. Smith . . . 512

Extraction Programs: A Unified Approach to Translation Rule Extraction

Mark Hopkins, Greg Langmead and Tai Vo . . . 523

Bayesian Extraction of Minimal SCFG Rules for Hierarchical Phrase-based Translation

Baskaran Sankaran, Gholamreza Haffari and Anoop Sarkar . . . 533

From n-gram-based to CRF-based Translation Models

Thomas Lavergne, Alexandre Allauzen, Josep Maria Crego and François Yvon . . . 542