You will need to connect them using either a LAN cable, setup static IP adddresses on both side.
Or get a cheap router - you get them for like 600 bucks - which will allow you to automatically connect each other.
You will need to connect to shared windows folders like this - smb://$WindowsIP/Name$
For accessing shared folders on Ubuntu from Windows - \\$UbuntuIP/Name$\