MEXDEBUG is obsolete. Use DBMEX instead. In order to debug MEX-files, MATLAB must be run within a debugger. To run MATLAB within a debugger start it by typing: where "debugger" is the name of the debugger you wish to use.