The article presents a comprehensive survey of usability evaluation methods, organized into a new taxonomy emphasizing automation. Usability evaluation is crucial in user interface design but is often time-consuming and resource-intensive. Automation can enhance existing methods by reducing costs, increasing consistency, and enabling broader coverage of usability issues. The survey identifies key areas where automation can be beneficial, such as capturing, analyzing, and critiquing usability data. It also highlights the limitations of current methods and suggests ways to improve them. The article introduces a new taxonomy for usability evaluation automation, categorizing methods based on method class, type, automation level, and effort required. It discusses various usability evaluation techniques, including testing, inspection, inquiry, analytical modeling, and simulation. The survey finds that automation is underexplored, with most methods requiring significant human effort. However, some methods, like guideline review, offer high levels of automation. The article then focuses on automating usability testing methods, discussing capture and analysis support. It highlights tools like KALDI, UsAGE, and WET for capturing user data, and tools like WebVIP and VISVIP for analyzing logs. These tools enable the collection of data from a larger number of users and provide insights into usability issues. The article also discusses automated analysis of log files, including metric-based, pattern-matching, task-based, and inferential approaches. These methods help identify usability problems by analyzing user behavior and task performance. The survey concludes that while automation offers significant benefits, further research is needed to develop more effective and efficient methods for usability evaluation.The article presents a comprehensive survey of usability evaluation methods, organized into a new taxonomy emphasizing automation. Usability evaluation is crucial in user interface design but is often time-consuming and resource-intensive. Automation can enhance existing methods by reducing costs, increasing consistency, and enabling broader coverage of usability issues. The survey identifies key areas where automation can be beneficial, such as capturing, analyzing, and critiquing usability data. It also highlights the limitations of current methods and suggests ways to improve them. The article introduces a new taxonomy for usability evaluation automation, categorizing methods based on method class, type, automation level, and effort required. It discusses various usability evaluation techniques, including testing, inspection, inquiry, analytical modeling, and simulation. The survey finds that automation is underexplored, with most methods requiring significant human effort. However, some methods, like guideline review, offer high levels of automation. The article then focuses on automating usability testing methods, discussing capture and analysis support. It highlights tools like KALDI, UsAGE, and WET for capturing user data, and tools like WebVIP and VISVIP for analyzing logs. These tools enable the collection of data from a larger number of users and provide insights into usability issues. The article also discusses automated analysis of log files, including metric-based, pattern-matching, task-based, and inferential approaches. These methods help identify usability problems by analyzing user behavior and task performance. The survey concludes that while automation offers significant benefits, further research is needed to develop more effective and efficient methods for usability evaluation.