It should be working. My guess would be that you're leaking IPv6 despite that option being enabled. Can you go to http://ipv6leak.com and see if you leak IPv6? If you do, try our guide on how to disable IPv6 completely as in some situations Windows ignores the firewall rules we insert that blocks IPv6.
Hmm, that's strange. The two connections are normal, as Windows sees the VPN as just another network adapter so it thinks you have two connections (which is technically true), but your real connection definitely shouldn't be recognized as having Internet connectivity while the killswitch is running.Can you submit a debug log so I can have a closer look as to what the app is doing?