In a brute force attack, attackers use automated tools to try numerous password combinations at high speed. These tools can guess passwords by attempting every possible combination or by cycling through common passwords. The process continues until the correct credentials are found, potentially compromising the security of the system.