With Spring Boot 1.2.5, disabling the autoconfiguration on the main application class seems to be enough:
@SpringBootApplication
@EnableAutoConfiguration(exclude = { VelocityAutoConfiguration.class })
Edit I don't exactly know since when that works, but now (Spring Boot 1.3.2) you can also set :
spring.velocity.enabled=false
in application.properties.