Yes you do, unless there is some legitimate medical reason for your inability to attend, in which case you may be able to delay your appointment. OWCP has every right to scheduled medical exams for you at “reasonable” intervals.