Do I need to check the translation myself?

Yes, verify the result before use. For texts in which an error could have serious consequences, review by a subject matter expert is required, just as with a human translation.