People talk about how awful Susan was but she wasn’t anywhere near as bad as Brian.
Brian was the only father Walt had ever known and he walked away from Walt days after his mother had died. He was way worse than Susan, at least she loved Walt. The real villain of Lost!