Towards a set of example documents for CAT tool comparison
Thread poster: Hans Lenting
Hans Lenting
Hans Lenting
Netherlands
Member (2006)
German to Dutch
Sep 30, 2012

(I'm taking these quotes out of another thread in this forum, just to make a new topic from it.)

I wrote:


When comparing printers people often use the famous Dr. Grauert letter:

http://de.wikipedia.org/wiki/Dr.-Grauert-Brief

Why not create such a benchmark text ourselves in order to test the quality of fuzzy matching and subsegment leverage, in order to compare our CAT tools?

What would be a good language combination for this?


And Michael B. responded:


Interesting idea about the 'Dr. Hans letter'. I suppose you would have to have one in every language someone might want to test. However, once one existed, MOUSE tool vendors could of course cheat by optimising their tool to handle that one page particularly well... Also, there would be the problem of selecting a type of text; technical, legal, literary, etc. Good luck!


I didn't say it would be simple . But I think it is time to take comparisons one step further. It is fascinating to know that CAT tool A has nicer buttons, a crispier font and a stunning grid than CAT tool B. But at the end of the day, what really matters is how well does a CAT tool perform with term recognition and TM matching.

And what could be against CAT tool vendors optimising their tools for a certain set of example documents? We can always make new version, e.g. to include new features of a certain DTP or word processor software.

Compliance with de facto standards as SDLXLIFF is a starting point, not the final goal. BTW, talking about this, I just read a horrible report from Duncan Bell in the Déjà Vu user list at Yahoo Groups. One quote I'd like to present here, because it describes a horrible scenario:


It's no pleasure to me at all to have to say that "very simple,
step-by-step explanations" are not possible in this case! It's a
complicated matter! The need to handle Studio files has added
considerably to our admin effort and time spent not translating but doing necessary peripheral work.


I remember that I once was very enthusiastic about the inter-CAT tool compatibility XLIFF would allow ...


 
Samuel Murray
Samuel Murray  Identity Verified
Netherlands
Local time: 16:27
Member (2006)
English to Afrikaans
+ ...
Different files to show different problems Sep 30, 2012

Hans Lenting wrote:
It is fascinating to know that CAT tool A has nicer buttons, a crispier font and a stunning grid than CAT tool B. But at the end of the day, what really matters is how well does a CAT tool perform with term recognition and TM matching.


Not really, no. What attracts me to a CAT tool is ease of use, not whether it has many features. If a UI is cumbersome, if I have to squint to see the text, if I have to use my mouse in awkward ways, if the cursor does not respond the way I expect it to respond, etc... those are things that speed me up or slow me down.

That said, I agree that a set of files would be nice to have. You can have a Word file with lots of hidden codes, to show how the various tools handle unzapped documents, for example. The "sample" files used by comparison videos are often deliberately sanitised so that the poor user won't be scared off by what *real* documents look like.

It's no pleasure to me at all to have to say that "very simple, step-by-step explanations" are not possible in this case! It's a complicated matter! The need to handle Studio files has added considerably to our admin effort and time spent not translating but doing necessary peripheral work.


Something can be simple and still require a lot of steps to perform. I suspect that what many people want with "simple" is something that doesn't take up too much of your time.


 
Hans Lenting
Hans Lenting
Netherlands
Member (2006)
German to Dutch
TOPIC STARTER
I think we agree Sep 30, 2012

Samuel Murray wrote:

Not really, no. What attracts me to a CAT tool is ease of use, not whether it has many features. If a UI is cumbersome, if I have to squint to see the text, if I have to use my mouse in awkward ways, if the cursor does not respond the way I expect it to respond, etc... those are things that speed me up or slow me down.


I take those features for granted so I think, basically we agree .

Hans


 


To report site rules violations or get help, contact a site moderator:


You can also contact site staff by submitting a support request »

Towards a set of example documents for CAT tool comparison







Trados Business Manager Lite
Create customer quotes and invoices from within Trados Studio

Trados Business Manager Lite helps to simplify and speed up some of the daily tasks, such as invoicing and reporting, associated with running your freelance translation business.

More info »
Anycount & Translation Office 3000
Translation Office 3000

Translation Office 3000 is an advanced accounting tool for freelance translators and small agencies. TO3000 easily and seamlessly integrates with the business life of professional freelance translators.

More info »