Machine Translation Archive
Index
to evaluation measures
Publications
1990-1999
For other periods
go to: Publications since
2010; publications
2005-2009; publications
2000-2004; publications
1970-1989; publications
before 1970
[To return to home page click here]
Back translation
(1999) Robert Frederking, Christopher Hogan,
& Alexander Rudnicky: A new approach to the translating telephone. Machine
Translation
(1999) Shoichi Yokoyama, Akira Kumano, Masaki
Matsudaira, Yoshiko Shirokizawa,
Mutsumi Kawagoe, Shuji Kodama, Hideki Kashioka,
Terumasa Ehara. Shinichiro Miyazawa & Yasuo Nakajima: Quantitative
evaluation of machine translation using two-way MT. Machine Translation
Confidence estimation
(1999) Arendse Bernth:
A confidence index for machine translation. Proceedings
of the 8th International Conference on Theoretical and Methodological Issues in
Machine Translation (TMI 99), August 23-25, 1999, University College,
Chester, England; pp. 109-119 [PDF, 158KB]
(1999) Arendse
Bernth: Controlling
input and output of MT for greater user acceptance. Translating and the
Computer 21. Proceedings of the Twenty-first International Conference…10-11
November 1999 (London: Aslib, 1999); 10pp. [PDF,
93KB]
Edit
distance
(1992) Keh-Yih Su, Ming-Wen Wu, &
Jing-Shin Chang: A new quantitative quality
measure for machine translation systems. Coling-92: Proceedings of the Fifteenth [i.e. Fourteenth] International
Conference on Computational Linguistics,
Error
detection and correction
(1999) Arendse Bernth:
A confidence index for machine translation. Proceedings
of the 8th International Conference on Theoretical and Methodological Issues in
Machine Translation (TMI 99), August 23-25, 1999, University College,
Chester, England; pp. 109-119 [PDF, 158KB]
(1999) June-Jei Kuo:
An automated mandarin document revision system using
both phonetic and radical approaches. Machine
Translation
(1999) Graham Russell: Errors of
omission in translation. Proceedings
of the 8th International Conference on Theoretical and Methodological Issues in
Machine Translation (TMI 99), August 23-25, 1999, University College,
Chester, England; pp. 128-138 [PDF, 131KB]
(1997)
Juan C.Amengual, José M.Benedí,
Francisco Casacuberta, Asunción Castaño,
Antonio Castellanos, David Llorens, Andrés Marzal, Federico Prat, Enrique Vidal, & Juan M.Vilar: Error correcting parsing for
text-to-text machine translation using finite state models. TMI-97: proceedings of the 7th International
Conference on Theoretical and Methodological Issues in Machine Translation,
July 23-25, 1997, St.John’s College, Santa Fe, New Mexico,
USA; pp.135-142. [PDF, 217KB]
(1997) Robert Frederking,
Alexander Rudnicky, & Christopher Hogan: Interactive speech translation in the DIPLOMAT
project. Spoken Language
Translation: proceedings of a workshop… ed. Steven Krauwer,
Doug Arnold, Walter Kasper, Manny Rayner, Harold Somers, 11 July 1997,
Universidad Nacional de Educación a Distancia, Madrid, Spain; pp.61-66. [PDF, 622KB]
(1996) I. Dan Melamed: Automatic detection of omissions in translations.
Coling 1996: the 16th International Conference on
Computational Linguistics: Proceedings, August 5-9, 1996, Center for Sprogteknologi,
(1995) Elliott Macklovitch: TransCheck – or the
automatic validation of human translations. MT
(1994) Tetsuo Araki, Satoru Ikehara, Nobuyuki
Tsukahara, & Yasunori
Komatsu: An evaluation to detect and correct
erroneous characters wrongly substituted, deleted and inserted in Japanese and
English sentences using Markov models. Coling 1994: the 15th International Conference on Computational Linguistics:
Proceedings, August 5-9, 1994,
(1992) Mitsugu Miura, Mikito
Hirata, & Nami Hoshino: Learning mechanism in machine translation system
“PIVOT”. Coling-92: Proceedings of
the Fifteenth [i.e. Fourteenth] International Conference on Computational
Linguistics,
(1990) Gregor Thurmair:
Parsing for grammar and style checking. Coling-90: Papers presented to the 13th
International Conference on Computational Linguistics, Helsinki, 20-25
August 1990; ed. Hans Karlgren; vol.2, pp. 365-370.
[PDF, 490KB]
Evaluation
measures and metrics [see
also Test corpora and test suites]
(1999) Arendse Bernth:
A confidence index for machine translation. Proceedings
of the 8th International Conference on Theoretical and Methodological Issues in
Machine Translation (TMI 99), August 23-25, 1999, University College,
Chester, England; pp. 109-119 [PDF, 158KB]
(1999) Lisa Decrozant & Clare R.Voss: Dual use of linguistic resources: evaluation of
MT systems and language learners. ACL-1999 Computer Mediated Language Assessment
and Evaluation in Natural Language Processing: Proceedings of a Symposium,
22 June 1999,
(1999) Jennifer Doyon, John S.White, &
Kathryn B.Taylor: Task-based
evaluation for machine translation. Machine Translation
(1999) Masaru
(1999) John
Hutchins: EAGLES Workshop,
(1999) Margaret King, Eduard Hovy, Benjamin
K. T’sou, John White, & Yusoff
Zaharin: MT evaluation
[panel]. Machine Translation
(1999) Graham Russell: Errors of
omission in translation. Proceedings
of the 8th International Conference on Theoretical and Methodological Issues in
Machine Translation (TMI 99), August 23-25, 1999, University College,
Chester, England; pp. 128-138 [PDF, 131KB]
(1999) Jörg Schütz:
Deploying the SAE J2450 translation quality
metric in MT projects. Machine
Translation
(1999) Jörg
Schütz: Deploying the
SAE J2450 translation quality metric in language technology evaluation projects.
Translating and the Computer 21. Proceedings of the Twenty-first
International Conference…10-11 November 1999 (London: Aslib,
1999); 10pp. [PDF, 69KB]
(1999) Toshiyuki Takezawa, Fumiaki Sugaya, Akio Yokoo, & Seiichi
Yamamoto: A new evaluation method for speech
translation systems and a case study on ATR-MATRIX from Japanese to English.
Machine Translation
(1999) Kavita Thomas: Designing a task-based evaluation methodology for a
spoken machine translation system. ACL-1999:
37th Annual Meeting of the Association for Computational Linguistics:
Proceedings of the conference, 20-26 June 1999, University of Maryland, College
Park, Maryland, USA; pp.569-572. [PDF, 396KB]
(1999) Yamauchi Satoshi: A method of
evaluation of the quality of translated text. Machine Translation
(1999) Shoichi Yokoyama, Akira Kumano, Masaki
Matsudaira, Yoshiko Shirokizawa,
Mutsumi Kawagoe, Shuji Kodama, Hideki Kashioka,
Terumasa Ehara. Shinichiro Miyazawa & Yasuo Nakajima: Quantitative
evaluation of machine translation using two-way MT. Machine Translation
(1998) D.Bourigault & B.Habert: Evaluation of
terminology extractors: principles and experiments. First International Conference on Language Resources & Evaluation,
(1998) Deborah Fry: Evaluating language technology: EAGLES II
workshop on evaluation standards and resource sharing. Language Today 7, April 1998; pp.6-7. [PDF, 1559KB]
(1998) Tony Hartley & Klaus
Schubert: From testbench
to workflow: relocating MT in education and training. Translating and
the Computer 20. Proceedings of the Twentieth International
Conference…12-13 November 1998 (London: Aslib, 1998);
10pp. [PDF, 59KB]
(1998) Margaret King & Bente
Maegaard: Issues in
natural language systems evaluation. First
International Conference on Language Resources & Evaluation,
(1998)
Judith Klein, Sabine Lehmann, Klaus Netter, & Tillmann
Wegst: DiET in the context of MT evaluation. Konvens ’98 Workshop: Evaluation of the Linguistic
Performance of Machine Translation Systems, Universität
Bonn (St Augustin: Gardez! Verlag,
1998); 21pp. [PDF, 112KB]
(1998) Philippe Langlais, Michel Simard,
& Jean Véronis: Methods and practical issues in evaluating
alignment techniques. Coling-ACL ’98: 36th Annual Meeting of the Association for
Computational Linguistics and 17th International Conference on Computational
Linguistics, August 10-14, 1998, Université de Montréal,
Montreal, Quebec, Canada; pp. 711-717. [PDF, 673KB]
(1998) Ph.Langlais, M.Simard, J.Véronis, S.Armstrong, P.Bonhomme, F.Debili, P.Isabelle, E.Souissi, & P.Théron: ARCADE: a cooperative research project on parallel
text alignment evaluation. First
International Conference on Language Resources & Evaluation,
(1998) Claus Povlsen, Nancy
Underwood, Bradley Music, & Anne Neville: Evaluating
text-type suitability for machine translation: a case study on an
English-Danish system. First
International Conference on Language Resources & Evaluation,
(1998) Reinhard Schäler: Localisation is
good for you: the Localisation Resources Centre as an example for the
successful co-operation between industrial users and academic researchers. First International Conference on Language
Resources & Evaluation,
(1998) Michelle Vanni: Evaluating MT
systems: testing and researching the feasibility of a task-diagnostic approach.
Translating and the Computer 20. Proceedings of the Twentieth
International Conference…12-13 November 1998 (London: Aslib,
1998); 11pp. [PDF, 152KB]
(1998) John S.White &
Kathryn B.Taylor: A
task-oriented evaluation metric for machine translation . First International Conference on Language
Resources & Evaluation,
(1997) John Hutchins: Evaluation of
machine translation and translation tools. In: Giovanni Battista Varile & Antonio Zampolli
(eds.) Survey of the state of the art in
human language technology (Pisa: Giardini), pp. 418-419. [PDF, 96KB]
(1997) Margaret King: Human factors and
user acceptability. In: Giovanni Battista Varile
& Antonio Zampolli (eds.) Survey of the state of the art in human language technology (Pisa:
Giardini), pp. 422-425. [PDF, 112KB]
(1997) Derek Lewis: MT evaluation: science or art? Translating
and the Computer 19. Papers from the Aslib
conference held on 13 & 14 November 1997 (London: Aslib,
1997); 9pp. [pages missing] [PDF, 32KB]
(1997) Derek Lewis: MT evaluation:
science or art? In: Machine
Translation Review, issue 6:
October 1997; pp.25-36.
(1997) Bente
Maegaard: Evaluation
of language tools. Translating and the Computer 19. Papers from the Aslib conference held on 13 & 14 November 1997 (London:
Aslib, 1997); 5pp. [PDF, 95KB]
(1997) Reinhard Schäler: Evaluation Workshop,
(1996) Lorna Balkan: Multilingual evaluation tool from TSNLP. In: MT News International no. 15, October 1996. [PDF]
(1996) Nicole Klingenburg: Technology impact assessment: translation
studies and its contribution to MT evaluation [abstract]. In: Unity in diversity? International translation studies conference,
Dublin City University, Dublin, Ireland, 9-11 May 1996; p.29. [PDF, 16KB]
(1996) Sergei Nirenburg: How can interlingual
representation systems be evaluated? [abstract] In: David Farwell (ed.) PREceedings of the Pre-Workshop on interlinguas and interlingual
approaches to machine translation, 1 October 1996, Montreal, [AMTA]; p.47
[PDF, 9KB]
(1996) Eric M. Visser & Masaru
(1996) John S.White & Theresa A.
O'Connell: Adaptation of the DARPA machine
translation evlauation paradigm to end-to-end systems.
Expanding MT horizons: Proceedings of the
Second Conference of the Association for Machine Translation in the Americas,
2-5 October 1996, Montreal, Quebec, Canada (Washington, DC: AMTA); pp.106-114
[PDF, 141KB]
(1996) John S.White: The primacy of core technology MT evaluation. Expanding MT horizons: Proceedings of the
Second Conference of the Association for Machine Translation in the Americas,
2-5 October 1996, Montreal, Quebec, Canada (Washington, DC: AMTA); pp.212-218
[PDF, 123KB]
(1995) Hitoshi Isahara: JEIDA’s test-sets
for quality evaluation of MT systems – technical evaluation from the
developer’s point of view . MT
(1995) Sylvie Regnier-Prost:
The prerequisites of MT for an industrial
user: a corpus-based approach. MT
(1995) John S. White: Approaches to black box MT evaluation. MT
(1994) Lorna Balkan Test
suites: some issues in their use and design. International conference “Machine translation: ten years on”
Proceedings ... held at
(1994) Lorna Balkan, Doug
Arnold, & Siety Meijer: Test suites for natural language processing. Translating and the Computer 16.
Papers presented at a conference… 10-11 November 1994, Institution of Civil
Engineers, London SW1 (London: Aslib, 1994);
pp.51-58. [PDF, 79KB]
(1994) George Doddington: Introduction
to the March ’94 ARPA workshop on machine translation. ARPA Workshop on Machine Translation, 17 March 1994, Sheraton
Premier Hotel at Tyson’s Corner,
(1994) George Doddington: Summation
and plans. ARPA Workshop on Machine
Translation, 17-18 March 1994, Sheraton Premier Hotel at Tyson’s Corner,
Vienna; 4 slides [PDF, 36KB]
(1994) Mary Flanagan: Error
classification for MT evaluation. Technology
partnerships for crossing the language barrier: Proceedings of the First
Conference of the Association for Machine Translation in the Americas,5-8
October, Columbia, Maryland, USA. [
(1994) Margaret King:
Evaluating translation. In: Christa Hauenschild &
Susanne Heizmann (eds.) Machine translation and translation theory.
[EAMT workshop,
(1994) Siety Meijer: The
evaluation of machine translation. British
Computer Society Natural Language Translation Specialist Group, Newsletter
no 22, April 1994; pp.12-13. [PDF, 62KB]
(1994) Siety Meijer & Lorna Balkan:
TSNLP: test suites for natural language processing. In: MT
News International no.8, May 1994
(1994) Eric H. Nyberg, 3rd, Teruko Mitamura,
& Jaime G. Carbonell: Evaluation metrics for knowledge-based machine
translation. Coling 1994: the 15th International Conference on
Computational Linguistics: Proceedings, August 5-9, 1994,
(1994) Karin Spalink: Proposal for a
differentiated text-related machine translation evaluation methodology. In: MT News International no.9, September 1994.
(1994) Antonio Torrens: Machine translation evaluation and quality
benchmarks. Terminologie et Traduction, 1.1994; pp.375-415. [PDF,
185KB]
(1994) John S.White &
Theresa A. O’Connell: Evaluation in the ARPA
machine translation program: 1993 methodology. Human Language Technology: proceedings of a workshop held at
(1994) John White, Theresa
O’Connell, & Matthew Hopwood: ARPA MT
initiative: 1Q94 test and evaluation. ARPA
Workshop on Machine Translation, 17 March 1994, Sheraton Premier Hotel at
Tyson’s Corner,
(1994) John S. White, Theresa A. O'Connell, Francis E. O'Mara: The ARPA MT evaluation methodologies: evolution, lessons,and future approaches.
Technology partnerships for crossing the
language barrier: Proceedings of the First Conference of the Association for
Machine Translation in the Americas,5-8 October, Columbia, Maryland, USA. [
(1994) The
role of MT evaluation. Panel at the First
Conference of the Association for Machine Translation in the Americas, 5-8
October 1994, Columbia, Maryland, USA (Washington, DC: AMTA); pp.217-219
[PDF, 75KB]
(1993) John Benoit & Joseph Pentheroudakis: MT
Showcase at the Evaluation Workshop. In:
MT News International no.4, January 1993. [PDF]
(1993) Bob Clark: Translating
in America: MT evaluation and new frontiers. Language International 5 (1), 1993; pp.29-31. [PDF, 179KB]
(1993) John Hutchins: JEIDA report on evaluation methodology. In: MT News Intenational no.4,
January 1993
(1993) Bertie Kaal: Evaluating machine translation in the 1990s:
Machine Translation Summit IV,
(1993) Margaret King: Evaluation of MT software and methods. Machine Translation Today: Translating and
the Computer 15. Papers presented at a conference… 18-19 November 1993, CBI
Conference Centre,
(1993) Hirosato Nomura & John Hutchins:
JEIDA machine translation evaluation methodology. In: MT
News Intenational no.5, May 1993
(1993) M. King: Panel
on evaluation: MT Summit IV -- introduction MT Summit IV: International Cooperation for Global Communication.
Proceedings, July 20-22, 1993,
(1993) Hirosato
Nomura: Evaluation
method of machine translation: from the viewpoint of natural language
processing. Strategy for machine translation evaluation MT Summit IV: International Cooperation
for Global Communication. Proceedings, July 20-22, 1993,
(1993) L. Rolling:
Panel
contribution on MT evaluation MT
Summit IV: International Cooperation for Global Communication. Proceedings,
July 20-22, 1993,
(1993) Muriel Vasconcellos: [contribution
to panel on] Evaluation method of machine translation MT Summit IV: International Cooperation
for Global Communication. Proceedings, July 20-22, 1993,
(1993) John S. White, Theresa A. O’Connell, & Lynn
M. Carlson: Evaluation of machine translation. Human
Language Technology: proceedings of a workshop held at
(1993) Soichi
Yokoyama: [contribution
to panel on] Evaluation method of machine translation: from the viewpoint of
natural language processing MT Summit IV:
International Cooperation for Global Communication. Proceedings, July 20-22,
1993,
(1993) Adriane Rinsche: Towards a MT evaluation methodology. TMI-93: The Fifth International Conference
on Theoretical and Methodological Issues in Machine Translation,
(1993) IAMT/AMTA Holds a Workshop on MT
Evaluation {
(1993) MT evaluation symposium at MT
World’92. In: MT
News International no.4, January 1993. [PDF]
(1992) see MT evaluation: basis for future directions.
Proceedings of a workshop sponsored by the National Science Foundation, 2-3
November 1992,
(1992) Jim Baker, Peter Brown, Lynn Carlson,
Eduard Hovy, Charles Wayne, & John White: Machine translation evaluation methodology. [
(1992) Peter Brown & Eduard Hovy: DARPA’s
(1992) Margaret King: Evaluators’ Forum, les
(1992) Margaret King: The Strategic Role of
Evaluation in Natural Language Processing and Speech Technology,
(1992) Keh-Yih Su, Ming-Wen Wu, &
Jing-Shin Chang: A new quantitative quality
measure for machine translation systems. Coling-92: Proceedings of the Fifteenth [i.e. Fourteenth] International
Conference on Computational Linguistics,
(1992) Translators still
in the loop. Language Industry
Monitor, issue no.12, November-December 1992; pp.1-4. [PDF, 106KB]
(1991) see Proceedings of the Evaluators’ Forum, April
21st – 24th, 1991, Les Rasses,
(1991) see contributions to panel Evaluation of MT systems. MT
(1991) Kenneth W.Church & Eduard H.Hovy: Good applications for crummy machine translation.
In: Jeanette G.Neal
and Sharon M.Walter (eds.): Natural Language
Processing Systems Evaluation Workshop, Calspan-UB
Research Center, Buffalo, NY, 18 June 1991;
pp.147-157. [PDF, 811KB]
(1991) Kenneth W.Church
& Eduard Hovy: Good
applications for crummy machine translation. (Information Sciences
Institute,
(1991) Monique C.Cormier:
Evaluation of machine translation systems.
Language International 3 (4), July
1991; p.8. [PDF, 63KB]
(1991) Jacques Durand: On
evaluating MT systems. Translating
and the Computer 13: The Theory and Practice of Machine Translation – A
Marriage of Convenience? Papers presented at a conference… 28-29 November
1991, CBI Conference Centre,
(1991) Björn
Gambäck, Hiyan Alshawi, David Carter & Manny Rayner: Measuring compositionality in transfer-based
machine translation systems. In: Jeanette
G.Neal and Sharon M.Walter
(eds.): Natural Language Processing Systems Evaluation Workshop, Calspan-UB Research Center,
Buffalo, NY, 18 June 1991; pp.141-145. [PDF, 322KB]
(1991) R.Lee Humphreys: From evaluation to specification. Translating
and the Computer 13: The Theory and Practice of Machine Translation – A
Marriage of Convenience? Papers presented at a conference… 28-29 November
1991, CBI Conference Centre,
(1991) MT evaluator’s forum.
Language Industry Monitor, issue
no.3, May-June 1991; p.5. [PDF, 97KB]
(1990) Peter Kahl : Translation quality –
how can we tell it’s good enough? Translating
and the Computer 12: Applying technology in the translation process, ed.
Catriona Picken. Proceedings of a conference… 8-9
November 1990, CBI Conference Centre,
(1990) Margaret King: A workshop on
evaluation: background paper. Third
international conference on Theoretical and Methodological Issues in Machine
Translation of Natural Language, 11-13 June 1990, Linguistics Research
Center, University of Texas; pp.255-259. [PDF, 95KB]
(1990) Margaret King & Kirsten Falkedal: Using test suites in evaluation of machine
translation systems. Coling-90:
Papers presented to the 13th International Conference on Computational
Linguistics, Helsinki, 20-25 August 1990; ed. Hans Karlgren;
vol.2, pp. 211-216. [PDF, 528KB]
Evaluations of systems [see also User experiences]
(1999) Michael Carl & Silvia Hansen: Linking translation
memories with example-based machine translation. Machine Translation
(1999) Orie Fukutomi:
Experiment report of a commercial machine
translation in a manufacturing industry domain. Machine
Translation
(1999) Elke D.Lange & Jin
Yang: Automatic domain recognition for machine
translation. Machine Translation
(1999) Magnus Merkel & Lars Ahrenberg: Evaluating word alignment systems. PLUG report. [
(1999) Shinichiro Miyazawa, Shoichi Yokoyama,
Masaki Matsudaira, Akira Kumano, Shuji Kodama, Hideki
Kashioka, Yoshiko Shirokizawa,
& Yasuo Nakajima: Study
on evaluation of WWW MT systems. Machine
Translation
(1999) Fumiaki Sugaya, Toshiyuki Takezawa, Akio Yokoo, & Seiichi Yamamoto: End-to-end evaluation in
ATR-MATRIX: speech translation system between English and Japanese. Sixth European Conference on Speech
Communication and Technology (Eurospeech ’99),
(1999) Shoichi Yokoyama, Akira Kumano, Masaki
Matsudaira, Yoshiko Shirokizawa,
Mutsumi Kawagoe, Shuji Kodama, Hideki Kashioka,
Terumasa Ehara. Shinichiro Miyazawa & Yasuo Nakajima: Quantitative
evaluation of machine translation using two-way MT. Machine Translation
(1998) Gregory Grefenstette:
Evaluating the adequacy of a
multilingual transfer dictionary for the cross language information retrieval.
First International Conference on
Language Resources & Evaluation,
(1998) Donna
Harman: The Text REtrieval
Conferences (TRECs) and the cross-language track. First International Conference on Language Resources & Evaluation,
(1998) Christopher Hogan & Robert E. Frederking:
An evaluation of the multi-engine MT architecture. Machine translation and the information soup: third conference of the
Association for Machine Translation in the Americas, AMTA '98, Langhorne,
PA,USA, October 1998; ed. David Farwell, Laurie Gerber, Eduard Hovy (Berlin: Springer Verlag,
1998); pp.113-123. [go to publisher
details]
(1998) Derek Lewis: Machine translation today. The Linguist
37, 2; pp.39-43. [PDF, 281KB]
(1998) Jutta Marx, Nancy Smith, & Bernhard
Staudinger: Some problems in the evaluation of the
Russian-German machine translation system MIROSLAV. First International Conference on Language Resources & Evaluation,
(1998) Mario J.Mira i
Giménez & Mikel L.Forcada:
Understanding commercial machine translation systems for evaluation, teaching,
and reverse engineering: the treatment of noun phrases in Power Translator
Deluxe. In: Machine
Translation Review, issue 7:
April 1998; pp.20-27. [PDF]
(1998) Douglas W. Oard: A comparative study
of query and document translation for cross-language information retrieval. Machine translation and the information
soup: third conference of the Association for Machine Translation in the
Americas, AMTA '98, Langhorne, PA,USA, October 1998; ed. David Farwell,
Laurie Gerber, Eduard Hovy (Berlin: Springer Verlag, 1998); pp.472-483. [go to publisher details]
(1998) Peter O’Rourke: Are we there yet?:
road-testing the latest in Japanese/English machine translation. Language International 10 (3), 1998;
pp.30-31. [PDF, 91KB]
(1998) Flo Reeder & Dan Loehr: Finding
the right words: an analysis of not-translated words in machine translation. Machine translation and the information
soup: third conference of the Association for Machine Translation in the
Americas, AMTA '98, Langhorne, PA,USA, October 1998; ed. David Farwell,
Laurie Gerber, Eduard Hovy (Berlin: Springer Verlag, 1998); pp.356-363. [go to publisher details]
(1998) Jörg Schütz
& Rita.Nübel: Evaluating language technologies: the
MULTIDOC approach to taming the knowledge soup. Machine translation and the information soup: third conference of the
Association for Machine Translation in the Americas, AMTA '98, Langhorne,
PA,USA, October 1998; ed. David Farwell, Laurie Gerber, Eduard Hovy (Berlin: Springer Verlag,
1998); pp.236-249. [go to publisher
details]
(1998) Jörg Schütz & Rita Nübel: Multi-purpose vs. task-specific application: diagnostic
evaluation of multilingual language technologies. First International Conference on Language Resources & Evaluation,
(1998) Vera Semenova: Russian resources in language engineering:
evaluation and description. First
International Conference on Language Resources & Evaluation,
(1998) Kathryn Taylor & John White: Predicting what MT is good for:
user judgements and task performance. Machine
translation and the information soup: third conference of the Association for
Machine Translation in the Americas, AMTA '98, Langhorne, PA,USA, October 1998;
ed. David Farwell, Laurie Gerber, Eduard Hovy
(Berlin: Springer Verlag, 1998); pp.364-373. [go to publisher details]
(1997) Merja Ågren:
The strong and the weak points of texts translated by
machine in comparison with texts translated by humans. [Unpublished.] 18pp.
[PDF, 105KB]
(1997) David Carter, Ralph Becket, Manny
Rayner, Robert Eklund, Catriona MacDermid,
Mats Wirén, Sabine Kirchmeier-Andersen,
& Christina Philp: Translation methodology in
the Spoken Language Translator: an evaluation. Spoken Language
Translation: proceedings of a workshop… ed. Steven Krauwer,
Doug Arnold, Walter Kasper, Manny Rayner, Harold Somers, 11 July 1997,
Universidad Nacional de Educación a Distancia, Madrid, Spain; pp.73-82. [PDF, 856KB]
(1997) Andrew Joscelyne:
Dictating progress to machines. Language International 9 (1), 1997;
pp.14-17. [PDF, 170KB]
(1997) Derek Lewis: The Telegraph
and Systran translation systems for personal
computer. In: Machine
Translation Review, issue 5: April
1997; pp.25-26.
(1997) Rita Nübel: End-to-end evaluation
in Verbmobil I.
MT
(1997) Reinhard Schäler: Evaluation of Translation Tools for Localisation: LRC Workshop,
(1997) Martin Volk: Probing
the lexicon in evaluating commercial MT systems. ACL-EACL-1997: 35th Annual Meeting of the Association for Computational
Linguistics and 8th Conference of the European Chapter of the Association for
Computational Linguistics: Proceedings of the Conference, 7-12 July 1997,
Universidad Nacional de Educación a Distancia (UNED), Madrid, Spain; pp. 112-119. [PDF, 729KB]
(1996) Harri Arnola:
Kielikone machine translation technology and its
perspective on the economics of machine translation. In: EAMT Workshop, Vienna, 29-30 August 1996. [PDF]
(1996) Eva Dauphin & Véronika Lux: Corpus-based annotated test set for machine
translation evaluation by an industrial user. Coling
1996: the 16th International Conference on Computational Linguistics:
Proceedings, August 5-9, 1996, Center for Sprogteknologi,
(1996) Stephen Helmreich & David Farwell:
Translation differences and pragmatics-based
MT. Expanding MT horizons:
Proceedings of the Second Conference of the Association for Machine Translation
in the Americas, 2-5 October 1996, Montreal, Quebec, Canada (Washington,
DC: AMTA); pp.43-55 [PDF, 162KB]
(1996) Heather Holmback, Serena Shubert, & Jan Spyridakis:
Issues in conducting empirical evaluations of
controlled languages. [CLAW 1996] Proceedings
of the first international workshop on controlled language applications: CLAW
96.
(1996) John Hutchins: ALPAC: the (in)famous
report. MT News International 14 (June 1996), 15-21. [PDF, 110KB]
(1996) Derek Lewis: The Power
Translator: an evaluation of a PC-based MT system. In: Machine Translation Review, issue 4: October 1996; pp.22-32.
(1996) Steven Maiorano
& Terry Wilson: Multilingual entity
task (MET): Japanese results. Tipster
Text Program Phase II.
Proceedings of a workshop held at
(1996) Roberta Merchant, Mary Ellen Okurowski, & Nancy Chinchor: The multilingual entity task (MET) overview.
Tipster Text Program Phase II. Proceedings of a workshop held at
(1996) Laurence Nazé:
Automatic translation by micro-computer:
evaluation of Power Translator. Language
International 8 (1), 1996; pp.3-5. [PDF, 140KB]
(1996) Dorothy Senez: Machine translation
feasibility study at the European Commission. In: EAMT
Workshop, Vienna, 29-30 August 1996. [PDF]
(1995)
Geert Adriaens & Lieve Macken: Technological evaluation
of a controlled language application: precision, recall and convergence tests
for SECC. TMI-95: proceedings of the Sixth
International Conference on Theoretical and Methodological Issues in Machine
Translation, July
5-7, 1995, Katholieke Universiteit,
Leuven, Belgium; pp.123-141. [PDF, 270KB]
(1995) Terence Lewis: Can we make do with near human quality? Translating
and the Computer 17. Papers from the Aslib
conference held on 9th and 10th November 1995 (London: Aslib,
1995); 5pp. [PDF, 40KB]
(1995) I.Dan Melamed: Automatic
evaluation and uniform filter cascades for inducing n-best translation lexicons.
Third workshop on Very Large
Corpora. Proceedings ed. David Yarowsky and
Kenneth Church, 30 June 1995, Massachusetts Institute of Technology,
(1995) William J.Niven:
Machine-friendly or reader-friendly? Language International 7 (6), 1995;
pp.4-10. [PDF, 309KB]
(1995) John S. White: Approaches to black box MT evaluation. MT
(1994) Claudia Gdaniec: The Logos translatability index. Technology partnerships for crossing the
language barrier: Proceedings of the First Conference of the Association for
Machine Translation in the Americas,5-8 October, Columbia, Maryland, USA. [
(1994) H. Isahara, H. Uchino, S. Ogino, T. Okunishi, S. Kinoshita,
S. Shibata, T. Sugio, Y. Takayama,
S. Doi, T. Nagano, M. Narita, H. Nomura: Technical evaluation of MT systems from the
developer's point of view: exploiting test-sets for quality evaluation. Technology partnerships for crossing the
language barrier: Proceedings of the First Conference of the Association for
Machine Translation in the Americas,5-8 October, Columbia, Maryland, USA. [
(1994) Geoffrey Kingscott:
Systran on PC
imminent. Language International
6 (5), 1994; pp.14-15. [PDF, 108KB]
(1994) Derek
Lewis: The MicroCat
machine assisted translation system. British
Computer Society Natural Language Translation Specialist Group, Newsletter
no 22, April 1994; pp.17-20. [PDF, 122KB]
(1994) Uwe Reinke: Evaluation of integrated
translation systems. In: MT News International no.9,
September 1994
(1994) Reinhard
Schäler: A practical
evaluation of an integrated translation tool during a large scale localisation
project. Fourth conference on Applied Natural Language Processing [of] Association for
Computational Linguistics. Proceedings of the conference, 13-15 October 1994,
(1994) Karin Spalink: Evaluating the
suitability of MT. Contribution to panel Voices
of experience: MT in operational settings at the First Conference of the Association for Machine Translation in the
Americas, 5-8 October 1994, Columbia, Maryland, USA (Washington, DC: AMTA);
pp.221-222 [PDF, 84KB]
(1994) Michelle Vanni: Project Cybertrans. Contribution to panel Voices of experience: MT in operational settings
at the First Conference of the
Association for Machine Translation in the Americas, 5-8 October 1994,
Columbia, Maryland, USA (Washington, DC: AMTA); pp.221-222 [PDF, 84KB]
(1994) John White, Theresa
O’Connell, & Matthew Hopwood: ARPA MT
initiative: 1Q94 test and evaluation. ARPA
Workshop on Machine Translation, 17 March 1994, Sheraton Premier Hotel at
Tyson’s Corner,
(1994) John White, Theresa
O’Connell, & Matthew Hopwood: Results 1Q94 ARPA
evaluation of machine translation. ARPA
Workshop on Machine Translation, March 17 1994, Sheraton Premier Hotel at
Tyson’s Corner,
(1993) Doris Albisser: Evaluating machine translation systems in a
real work environment. [Expanded version.] In: Sergei Nirenburg
(ed.) Progress in machine translation
(Amsterdam, Oxford, Washington, DC: IOS Press; Tokyo: Ohmsha,
1993), pp. 278-282. [PDF, 117KB]
(1993) Sabine Bell: Translator’s Workbench II. Language International 5 (3), 1993;
pp.5-7. [PDF, 167KB]
(1993) Masaru
Tomita, Masako Shirai, Junya
Tsutsumi, Miki Matsumura & Yuki Yoshikawa: Evaluation of MT systems by TOEFL. TMI-93: The Fifth International Conference
on Theoretical and Methodological Issues in Machine Translation,
(1993) J.D.Wigg: Software review:
“French Assistant” by Microtac. British Computer Society Natural Language
Translation Specialist Group, Newsletter no 21, April 1993; pp.21-26. [PDF,
189KB]
(1993) A heavy METAL user.
Language Industry Monitor, issue
no.18, November-December 1993; pp.11-12. [PDF, 91KB]
(1992) Sabine Bell: TRANSIT: the ideal working environment for
translators. Language International
4 (6), 1992; pp.3-6. [PDF, 213KB]
(1992) R.Lee
Humphreys: Is machine translation actually
translation? Language International
4 (2), 1992; pp.7-11. [PDF, 201KB]
(1992 Khai Le-Hong, Monika Höge, & Andrea Hohmann: User’s point of view of the translator’s workbench.
Translating and the Computer 14: Quality Standards and the Implementation of
Technology in Translation. Papers presented at a conference… 10-11 November
1992, CBI Conference Centre,
(1992) J.E.Rowley: Evaluation of software. Translating and the Computer 14: Quality
Standards and the Implementation of Technology in Translation. Papers
presented at a conference… 10-11 November 1992, CBI Conference Centre,
(1992) see MT evaluation: basis for future directions.
Proceedings of a workshop sponsored by the National Science Foundation, 2-3
November 1992,
(1991) see Proceedings of the Evaluators’ Forum, April
21st – 24th, 1991, Les Rasses,
Examples
of MT output
(1999) Arendse
Bernth: Controlling
input and output of MT for greater user acceptance. Translating and the
Computer 21. Proceedings of the Twenty-first International Conference…10-11
November 1999 (London: Aslib, 1999); 10pp. [PDF,
93KB]
(1999) John Hutchins: The
IBM-Georgetown demonstration, January 1954. Language Today no.16
(January 1999), 19-20. [PDF, 106KB]
(1999) Terence Lewis: The best of both worlds – or
will two mongrels ever make a pedigree. Translating and the Computer 21.
Proceedings of the Twenty-first International Conference…10-11 November 1999
(London: Aslib, 1999); 9pp. [PDF, 63KB]
(1998) John Beaven: MT: 10 years of
development. Terminologie et Traduction,
1.1998; pp.242-256. [PDF, 56KB]
(1998) Kaarina
Hyvönen & Harri Arnola: Kielikone MT takes user-friendliness seriously. Translating
and the Computer 20. Proceedings of the Twentieth International
Conference…12-13 November 1998 (London: Aslib, 1998);
14pp. [PDF, 108KB]
(1998) Derek Lewis: Machine
translation today. The Linguist
37 (2); pp.38-43. [PDF, 281KB]
(1998) Rosemarie Sauer-Stipperger: SYSTRAN
funnies. Terminologie et Traduction,
1.1998; pp.327-329. [PDF, 22KB]
(1996) Harri Arnola, Kaarina Hyvönen, Jukka-Pekka Juntunen, Tim Linnanvirta, &
Petteri Suoranta: Kielikone Finnish-English MT system TranSmart
in practical use. Translating and the Computer 18. Papers from the Aslib conference held on 14 & 15 November 1996 (London:
Aslib, 1996); 17pp. [PDF, 200KB]
(1996) John Hutchins: ALPAC: the (in)famous report. MT News International 14 (June
1996), 15-21. [PDF, 110KB]
(1995) Terence Lewis: Can we make do with near human quality? Translating
and the Computer 17. Papers from the Aslib
conference held on 9th and 10th November 1995 (London: Aslib,
1995); 5pp. [PDF, 40KB]
(1994) John Hutchins: The
Georgetown-IBM demonstration, 7th January 1954. MT News International
8 (May 1994), 15-18. [PDF, 103KB]
(1992) Annette Grimaila
& John Chandioux: Made to measure solutions. In:
John Newton (ed.) Computers in translation: a
practical appraisal (London: Routledge, 1992),;
pp.33-45.
(1992) Muriel Vasconcellos
& Dale A. Bostad: Machine translation in a
high-volume translation environment. In: John Newton (ed.) Computers in translation: a practical appraisal
(London: Routledge, 1992),; pp.58-77.
(1991) Teruko Mitamura, Eric
H. Nyberg, 3rd, & Jaime G. Carbonell: An efficient interlingua
translation system for multi-lingual document production. MT
Quality
assurance
(1998) Thorsten Mehnert: Quality policy:
comply or compete? Language
International 10 (5), 1998; pp.12-15. [PDF, 220KB]
(1992) Siegrun
O’Sullivan: Quality management in
translation. Translating and the Computer
14: Quality Standards and the Implementation of Technology in Translation. Papers presented at a conference…
10-11 November 1992, CBI Conference Centre,
(1992) Linda J. Wedlake: An introduction to quality assurance and a guide
to the implementation of BS 5750 , Translating and the Computer 14:
Quality Standards and the Implementation of Technology in Translation.
Papers presented at a conference… 10-11 November 1992, CBI Conference Centre,
Quality improvement techniques
(see also Interactive methods)
(1999) Key-Yih Su & Jing-Shin Chang: A customizable, self-learnable parameterized MT system:
the next generation. Machine Translation
(1998) Sung-Kwon Choi, Han-Min Jung, Chul-Min
Sim, Taewan Kim, Dong-In Park,
(1997)
Kanlaya Naruedomkul &
Nick Cercone: Steps toward
accurate machine translation. TMI-97:
proceedings of the 7th International Conference on Theoretical and
Methodological Issues in Machine Translation, July 23-25, 1997, St.John’s College, Santa Fe, New Mexico, USA; pp.63-75.
[PDF, 656KB]
(1996) Tetsuya Nasukawa: Full-text processing: improving a practical NLP
system based on surface information within the context. Coling 1996: the 16th International Conference on Computational Linguistics:
Proceedings, August 5-9, 1996, Center for Sprogteknologi,
(1991) Wanying Jin: Translation accuracy and
translation efficiency. MT
(1991) Yorick Wilks:
Determining the development potential of machine translation systems: the role
of evaluation techniques [contribution to panel] Evaluation
of MT systems. MT
(1996) Heather Holmback, Serena Shubert, & Jan Spyridakis:
Issues in conducting empirical evaluations of
controlled languages. [CLAW 1996] Proceedings
of the first international workshop on controlled language applications: CLAW
96.
(1993) Masaru Tomita, Masako Shirai,
Junya Tsutsumi, Miki
Matsumura & Yuki Yoshikawa: Evaluation
of MT systems by TOEFL. TMI-93: The
Fifth International Conference on Theoretical and Methodological Issues in
Machine Translation,
Test corpora and test suites
(1996) Eva Dauphin & Véronika Lux: Corpus-based annotated test set for machine
translation evaluation by an industrial user. Coling
1996: the 16th International Conference on Computational Linguistics:
Proceedings, August 5-9, 1996, Center for Sprogteknologi,
(1996) Sabine Lehmann, Stephan Oepen, Sylvie Regnier-Prost, Klaus Netter, Veronika Lux, Judith Klein,
Kirsten Falkedal, Frederick Fouvry,
Dominique Estival, Eva Dauphin, Hervé
Compagnion, Judith Baur,
Lorna Balkan, & Doug Arnold: TSNLP – test
suites for natural language processing. Coling 1996: the 16th International Conference on Computational Linguistics:
Proceedings, August 5-9, 1996, Center for Sprogteknologi,
(1995) Hitoshi Isahara: JEIDA’s test-sets
for quality evaluation of MT systems – technical evaluation from the
developer’s point of view . MT
(1994) Lorna Balkan, Doug
Arnold, & Siety Meijer: Test suites for natural language processing. Translating and the Computer 16. Papers
presented at a conference… 10-11 November 1994, Institution of Civil Engineers,
London SW1 (London: Aslib, 1994); pp.51-58. [PDF,
79KB]
(1991) Gerardo Arrarte, Teófilo Redondo, Miguel Sobejano,
& Isabel Zapata: A management tool for
test corpora. Proceedings of the Evaluators’ Forum, April 21st – 24th, 1991, Les Rasses,
(1991) Ulrich Heid &
Elke Hildenbrand: Some
practical experience with the use of test suites for the evaluation of SYSTRAN. Proceedings
of the Evaluators’ Forum, April 21st – 24th, 1991, Les Rasses,
(1991) R.Lee Humphreys: From evaluation to specification. Translating
and the Computer 13: The Theory and Practice of Machine Translation – A
Marriage of Convenience? Papers presented at a conference… 28-29 November
1991, CBI Conference Centre,
(1991) R. Lee Humphreys: User-oriented MT evaluation and text typology. Proceedings
of the Evaluators’ Forum, April 21st – 24th, 1991, Les Rasses,
(1991) Yves Lepage: Test suites as a means for the evaluation of
machine translation systems. Proceedings of the Evaluators’ Forum,
April 21st – 24th, 1991, Les Rasses,
(1991)
(1990) Margaret King & Kirsten Falkedal: Using test suites in evaluation of machine
translation systems. Coling-90:
Papers presented to the 13th International Conference on Computational
Linguistics, Helsinki, 20-25 August 1990; ed. Hans Karlgren;
vol.2, pp. 211-216. [PDF, 528KB]
Translatability
(1999) Arendse Bernth:
A confidence index for machine translation. Proceedings
of the 8th International Conference on Theoretical and Methodological Issues in
Machine Translation (TMI 99), August 23-25, 1999, University College,
Chester, England; pp. 109-119 [PDF, 158KB]
(1999) Nicholas Ostler: “The limits of my language mean the limits of my
world”: is machine translation a cultural threat to anyone? [extended
abstract] Proceedings of the 8th International Conference on Theoretical and
Methodological Issues in Machine Translation (TMI 99), August 23-25, 1999,
University College, Chester, England; pp. 172-173 [PDF, 99KB]
(1999) Nancy L. Underwood & Bart Jongejan:
Profiling translation projects: an essential
part of routing translations. Proceedings of the 8th International
Conference on Theoretical and Methodological Issues in Machine Translation (TMI
99), August 23-25, 1999, University College, Chester, England; pp. 139-149
[PDF, 154KB]
(1998) Claus Povlsen, Nancy
Underwood, Bradley Music, & Anne Neville: Evaluating
text-type suitability for machine translation: a case study on an
English-Danish system. First
International Conference on Language Resources & Evaluation,
(1998) Reinhard Schäler: Localisation is
good for you: the Localisation Resources Centre as an example for the
successful co-operation between industrial users and academic researchers. First International Conference on Language
Resources & Evaluation,
(1996) Heather Holmback, Serena Shubert, & Jan Spyridakis:
Issues in conducting empirical evaluations of
controlled languages. [CLAW 1996] Proceedings
of the first international workshop on controlled language applications: CLAW
96.
(1996) Linda Means & Kurt
Godden: The controlled automotive service
language (CASL) project. [CLAW 1996] Proceedings
of the first international workshop on controlled language applications: CLAW
96.
(1994) Claudia Gdaniec: The Logos translatability index. Technology partnerships for crossing the
language barrier: Proceedings of the First Conference of the Association for
Machine Translation in the Americas,5-8 October, Columbia, Maryland, USA. [
(1994) David Kumhyr, Carla Merrill, &
Karin Spalink: Internationalization
and translatability. Technology
partnerships for crossing the language barrier: Proceedings of the First
Conference of the Association for Machine Translation in the Americas,5-8
October, Columbia, Maryland, USA. [
Usability of systems
(1997) Terence Lewis: Do you have a translation
tool strategy? Language
International 9 (5), 1997; pp.16-18. [PDF, 143KB]
User evaluation and feedback
(1993) Siety
Meijer: Attitudes towards machine translation.
Language International 5 (6), 1993;
pp.11-13. [PDF, 121KB]