Embedded Files
Share feedback about my content
** You can give your thought about this content and request modifications if needed from Ask For Modifications page. Thank You.
** You can check all the posts on the Posts page.
** More about me in the About Me section.
VxLAN overlay network āĻŦā§āĻ¯āĻŦāĻšāĻžāĻ° āĻāĻ°ā§ multi-container host networking āĻ¤ā§āĻ°āĻŋ āĻāĻ°āĻž [ āĻĒāĻ°ā§āĻŦ - ā§¨ ]
āĻ āĻ¨ā§āĻ°ā§āĻ§ - āĻāĻ āĻ˛āĻŋāĻāĻž āĻĒā§ā§ āĻ¯āĻĻāĻŋ āĻŽāĻ¨ā§ āĻšā§ āĻā§āĻ¨ āĻāĻŋāĻ¨āĻŋāĻ¸ āĻ¯ā§āĻā§āĻ¤ āĻāĻ°ā§ āĻĻāĻŋāĻ˛ā§ āĻāĻžāĻ˛ā§ āĻšā§ āĻ¯ā§āĻāĻž āĻāĻŽāĻŋ āĻāĻ°āĻŋ āĻ¨āĻŋ ... āĻāĻžāĻāĻ¨ā§āĻĄāĻ˛āĻŋ āĻāĻŽā§āĻ¨ā§āĻā§ āĻāĻžāĻ¨āĻžāĻŦā§āĻ¨ āĻ āĻĨāĻŦāĻž ssavi.ict@gmail.com āĻ āĻāĻāĻāĻž āĻŽā§āĻāĻ˛ āĻ˛āĻŋāĻā§ āĻĻā§āĻŦā§āĻ¨āĨ¤ āĻāĻŽāĻŋ āĻā§āĻ°ā§āĻĄāĻŋāĻ āĻĻāĻŋā§ā§ āĻ¯ā§āĻā§āĻ¤ āĻāĻ°ā§ āĻĻā§āĻŦā§āĨ¤ āĻāĻžāĻ āĻāĻž āĻāĻ°āĻ¤ā§ āĻāĻŋā§ā§ āĻŦā§āĻļ āĻāĻŋāĻā§ āĻ¸āĻŽāĻ¸ā§āĻ¯āĻžāĻ° āĻ¸āĻŽā§āĻŽā§āĻā§āĻ¨ āĻšā§ā§āĻāĻŋāĻ˛āĻžāĻŽāĨ¤ āĻ¸ā§āĻā§āĻ˛ā§āĻ° āĻ¯ā§āĻāĻžāĻŦā§ āĻ¸āĻŽāĻžāĻ§āĻžāĻ¨ āĻāĻ°ā§āĻāĻŋ āĻ¤āĻž āĻāĻ FAQ and Troubleshoot āĻĒā§āĻ āĻ āĻ˛āĻŋāĻā§āĻāĻŋāĨ¤ āĻšā§āĻ¤ā§ āĻāĻĒāĻ¨āĻžāĻ° āĻāĻžāĻā§ āĻ˛āĻžāĻāĻ¤ā§ āĻĒāĻžāĻ°ā§āĨ¤
āĻ¸ā§āĻā§āĻĒ - ā§§ā§ŠāĻ āĻāĻŦāĻžāĻ° veth0 āĻāĻŦāĻ veth1 āĻāĻ¨ā§āĻāĻžāĻ°āĻĢā§āĻ¸ āĻāĻ° IP address āĻ¸ā§āĻ āĻāĻ°āĻŦā§āĨ¤ āĻ¸ā§āĻāĻ¨ā§āĻ¯ āĻ¨āĻŋāĻā§āĻ° āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻā§āĻ˛ā§ āĻĻā§āĻŦā§ āĻāĻŦāĻ log āĻā§āĻ˛ā§ āĻā§āĻ āĻāĻ°āĻŦā§ -Â
-------------------------------- VM1 āĻāĻŦāĻ VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo ip address add 192.168.1.1/24 dev veth0
vagrant@ubuntu-bionic:~$ sudo ip address add 192.168.2.1/24 dev veth1
vagrant@ubuntu-bionic:~$ sudo ip a
8: veth0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 5e:68:e0:15:60:07 brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.1/24 scope global veth0
       valid_lft forever preferred_lft forever
9: veth1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether fa:c3:cf:33:02:52 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.1/24 scope global veth1
       valid_lft forever preferred_lft forever
āĻĒā§āĻ°āĻļā§āĻ¨ āĻāĻ¸āĻ¤ā§ āĻĒāĻžāĻ°ā§... āĻ āĻ¨ā§āĻ¯ IP Address āĻāĻŋ āĻ¸ā§āĻ āĻāĻ°āĻž āĻ¯āĻžā§āĨ¤ āĻāĻ¤ā§āĻ¤āĻ° āĻšāĻ˛ā§ ... āĻšā§āĻ¯āĻž āĻāĻ°āĻž āĻ¯āĻžā§āĨ¤ āĻāĻŽāĻŋ āĻ¨āĻŋāĻā§āĻ āĻāĻ°ā§āĻāĻŋ ... āĻ¤āĻŦā§ āĻ¸āĻĢāĻ˛āĻāĻžāĻŦā§ āĻāĻ āĻĒāĻžāĻļā§āĻ° VM Docker Container āĻĨā§āĻā§ āĻ āĻ¨ā§āĻ¯ āĻĒāĻžāĻļā§āĻ° VM Docker Container āĻā§ PING āĻāĻ°āĻžāĻ¤ā§ āĻĒāĻžāĻ°āĻŋ āĻ¨āĻŋāĨ¤ āĻšā§āĻ¤ā§ āĻ°āĻžāĻāĻāĻŋāĻ āĻāĻ° āĻā§āĻĨāĻžāĻ āĻā§āĻ˛ āĻšā§ā§āĻāĻŋāĻ˛ā§āĨ¤ āĻāĻĒāĻ¨āĻŋ āĻ¯āĻĻāĻŋ āĻāĻ°āĻ¤ā§ āĻĒāĻžāĻ°ā§āĻ¨ āĻ¤āĻžāĻšāĻ˛ā§ āĻāĻŽāĻžāĻ° āĻ¸āĻžāĻĨā§ āĻļā§ā§āĻžāĻ° āĻāĻ°āĻŦā§āĻ¨āĨ¤Â
āĻ¸ā§āĻā§āĻĒ - ā§§ā§ĒāĻ āĻāĻ¨ā§āĻāĻžāĻ°āĻĢā§āĻ¸ āĻā§āĻ˛ā§ āĻā§ Up and Running āĻāĻ°āĻŦā§āĨ¤ āĻāĻ° āĻāĻ¨ā§āĻ¯ā§ āĻ¨āĻŋāĻā§āĻ° āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻā§āĻ˛ā§ āĻĻā§āĻŦā§ āĻāĻŦāĻ āĻāĻ¨ā§āĻāĻžāĻ°āĻĢā§āĻ¸ āĻāĻ° āĻŽāĻ§ā§āĻ¯ā§ UP/UNKNOWN āĻ˛āĻŋāĻāĻž āĻāĻā§ āĻāĻŋāĻ¨āĻž āĻāĻ¨āĻļāĻŋāĻāĻ° āĻāĻ°āĻŦā§āĨ¤
-------------------------------- VM1 āĻāĻŦāĻ VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo ip link set dev veth0 up mtu 1450
vagrant@ubuntu-bionic:~$ sudo ip link set dev veth1 up mtu 1450
vagrant@ubuntu-bionic:~$ sudo ip a
8: veth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether 5e:68:e0:15:60:07 brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.1/24 scope global veth0
       valid_lft forever preferred_lft forever
    inet6 fe80::5c68:e0ff:fe15:6007/64 scope link
       valid_lft forever preferred_lft forever
9: veth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN group default qlen 1000
    link/ether fa:c3:cf:33:02:52 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.1/24 scope global veth1
       valid_lft forever preferred_lft forever
    inet6 fe80::f8c3:cfff:fe33:252/64 scope link
       valid_lft forever preferred_lft forever
āĻāĻāĻ¨ āĻĨā§āĻā§ āĻĒāĻ°āĻŦāĻ°ā§āĻ¤ā§ āĻ¸ā§āĻā§āĻĒ āĻā§āĻ˛ā§ āĻā§āĻŦāĻ āĻ¸āĻ¤āĻ°ā§āĻāĻ¤āĻžāĻ° āĻ¸āĻžāĻĨā§ āĻāĻ°āĻ¤ā§ āĻšāĻŦā§āĨ¤ āĻāĻ āĻ¸ā§āĻā§āĻĒ āĻā§āĻ˛ā§ āĻ¤ā§ āĻā§āĻŦ āĻŦā§āĻļāĻŋ āĻā§āĻ˛ āĻšā§āĨ¤ āĻāĻŦāĻ āĻĢāĻ˛āĻžāĻĢāĻ˛ āĻ āĻŋāĻāĻ āĻžāĻ PING āĻšā§ āĻ¨āĻžāĨ¤ āĻŽāĻžāĻĨāĻžāĻ° āĻā§āĻ˛ āĻā§ā§āĻž āĻ˛āĻžāĻā§āĨ¤
āĻ¸ā§āĻā§āĻĒ - ā§§ā§ĢāĻ āĻĒāĻ°āĻŦāĻ°ā§āĻ¤ā§ āĻ¸ā§āĻā§āĻĒ āĻšāĻā§āĻā§ āĻĒā§āĻ°āĻ¤ā§āĻ¯ā§āĻ āĻāĻž VM āĻāĻ° āĻŽāĻ§ā§āĻ¯ā§ āĻāĻ˛āĻžāĻĻāĻž āĻāĻžāĻŦā§ āĻĻā§āĻā§ āĻāĻ°ā§ Docker Container āĻ¸ā§āĻ āĻāĻ°āĻžāĨ¤ āĻāĻ° āĻāĻ¨ā§āĻ¯ āĻ¨āĻŋāĻā§āĻ° Docker āĻĢāĻžāĻāĻ˛ āĻā§āĻĄ āĻ¸ā§āĻ¨āĻŋāĻĒā§āĻ āĻāĻž āĻŦā§āĻ¯āĻŦāĻšāĻžāĻ° āĻāĻ°ā§āĻāĻŋ āĻāĻŽāĻŋāĨ¤
FROM ubuntu
RUN apt update
RUN apt install -y net-tools
RUN apt install -y iproute2
RUN apt install -y iputils-ping
CMD ["sleep", "7200"]
āĻāĻ āĻā§āĻĄ āĻāĻŋ VM1 āĻāĻŦāĻ VM2 āĻ¤ā§ āĻĒā§āĻļ āĻāĻ°āĻ¤ā§ āĻšāĻŦā§āĨ¤ āĻŦāĻž VM āĻ āĻāĻāĻāĻŋ Dockerfile āĻ¤ā§āĻ°āĻŋ āĻāĻ°ā§ āĻ¸ā§āĻāĻžāĻ¨ā§ āĻĒā§āĻ¸ā§āĻ āĻāĻ°āĻ¤ā§ āĻšāĻŦā§āĨ¤ āĻāĻŽāĻŋ (ā§¨) āĻ¨āĻžāĻŽā§āĻŦāĻžāĻ° āĻŽāĻžāĻ¨ā§ āĻĢāĻžāĻāĻ˛ āĻ¤ā§āĻ°āĻŋ āĻāĻ°ā§ āĻĒā§āĻ¸ā§āĻ āĻāĻ°ā§āĻāĻŋ āĻ¸ā§āĻ¨āĻŋāĻĒā§āĻ āĻāĻŋāĨ¤ āĻ¸ā§āĻāĻ¨ā§āĻ¯ āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻ¨āĻŋāĻā§āĻ° āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻā§āĻ˛ā§ āĻ˛āĻŋāĻāĻŦā§ -Â
-------------------------------- VM1 āĻāĻŦāĻ VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ touch Dockerfile
vagrant@ubuntu-bionic:~$ vi Dockerfile
āĻāĻāĻž āĻāĻ°āĻ˛ā§ āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻāĻ° VIM āĻāĻĄāĻŋāĻāĻ°ā§ āĻā§āĻā§āĻ¸āĻ āĻāĻĄāĻŋāĻ āĻāĻ°āĻžāĻ° āĻĢā§āĻ¯āĻžāĻ¸āĻŋāĻ˛āĻŋāĻāĻŋ āĻāĻĒā§āĻ¨ āĻšāĻŦā§āĨ¤ āĻ¸ā§āĻāĻžāĻ¨ā§ āĻāĻĒāĻ°ā§āĻ° āĻ¸ā§āĻ¨āĻŋāĻĒā§āĻ āĻāĻŋ Copy āĻāĻ°ā§ Paste āĻāĻ°āĻŦā§āĨ¤ āĻāĻ°āĻĒāĻ° ESC āĻŦāĻžāĻāĻ¨ āĻāĻžāĻĒāĻŦā§āĨ¤ āĻāĻ°āĻĒāĻ°, āĻāĻĄāĻŋāĻāĻ°ā§āĻ° āĻāĻĒāĻ°ā§āĻ :wq! āĻāĻ āĻā§āĻĄ āĻĻāĻŋāĻ˛ā§ āĻ¸ā§āĻ¨āĻŋāĻĒā§āĻ āĻāĻŋ Dockerfile āĻĢāĻžāĻāĻ˛ā§ āĻ¸ā§āĻ āĻšā§ā§ āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻāĻĄāĻŋāĻāĻ° āĻĨā§āĻā§ āĻŦā§āĻ°āĻŋā§ā§ āĻāĻ¸āĻŦā§āĨ¤ āĻāĻ° āĻĒāĻ° āĻ¨āĻŋāĻā§āĻ° āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻĻāĻŋā§ā§ āĻ āĻŋāĻāĻ āĻžāĻ āĻĢāĻžāĻāĻ˛ āĻāĻŋ āĻ˛āĻŋāĻāĻž āĻšāĻ˛ā§ āĻāĻŋāĻ¨āĻž āĻā§āĻ āĻāĻ°āĻŦā§āĨ¤Â
vagrant@ubuntu-bionic:~$ cat Dockerfile
FROM ubuntu
RUN apt update
RUN apt install -y net-tools
RUN apt install -y iproute2
RUN apt install -y iputils-ping
CMD ["sleep", "7200"]
touch <filename> āĻĻāĻŋā§ā§ āĻ¨āĻ¤ā§āĻ¨ āĻĢāĻžāĻāĻ˛ āĻ¤ā§āĻ°āĻŋ āĻāĻ°āĻž āĻšā§ āĻāĻŦāĻ cat <filename> āĻĻāĻŋā§ā§ āĻĢāĻžāĻāĻ˛ā§āĻ° āĻāĻ¨ā§āĻā§āĻ¨ā§āĻ āĻā§āĻ˛ā§ āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻ āĻĻā§āĻāĻž āĻšā§āĨ¤
āĻ¸ā§āĻā§āĻĒ - ā§§ā§ŦāĻ āĻāĻ°āĻĒāĻ° VM1 āĻāĻŦāĻ VM2 āĻ¤ā§ āĻĻā§āĻā§ āĻāĻ°ā§ Docker Container āĻ¤ā§āĻ°āĻŋ āĻāĻ°ā§ āĻ¨ā§āĻŦā§ build āĻāĻ°āĻž Ubuntu Docker Engine āĻĻāĻŋā§ā§āĨ¤ āĻ¨āĻŋāĻā§āĻ° āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻā§āĻ˛ā§ āĻĻā§āĻŦā§ āĻāĻŦāĻ āĻ˛āĻ āĻā§āĻ˛ā§ āĻā§āĻ āĻāĻ°āĻŦā§ -Â
-------------------------------- VM1 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo docker build . -t ubuntu-docker
Sending build context to Docker daemon 15.36kB
Step 1/6 : FROM ubuntu
.........Â
Step 6/6 : CMD ["sleep", "7200"]
.........
Successfully built 9ae522bebcb9
Successfully tagged ubuntu-docker:latest
vagrant@ubuntu-bionic:~$ sudo docker run -d --net=none --name docker1 ubuntu-docker
087db9e04b10630f56c0b69ab5233bd181c1e3f48c654346f6be90c0d151fcfd
vagrant@ubuntu-bionic:~$ sudo docker run -d --net=none --name docker2 ubuntu-docker
cfeec0152a1236e2dd005ae0e09f55f9862a23cbdc06fd7f4ce64b2a1113a641
vagrant@ubuntu-bionic:~$ sudo docker ps
CONTAINER ID Â IMAGE Â Â Â Â Â COMMANDÂ Â Â Â CREATEDÂ Â Â Â Â STATUSÂ Â Â Â Â PORTS Â Â NAMES
cfeec0152a12  ubuntu-docker  "sleep 7200"  5 seconds ago  Up 5 seconds       docker2
087db9e04b10  ubuntu-docker  "sleep 7200"  16 seconds ago  Up 15 seconds       docker1
-------------------------------- VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------
vagrant@ubuntu-bionic:~$ sudo docker build . -t ubuntu-docker
Sending build context to Docker daemon 15.36kB
Step 1/6 : FROM ubuntu
.........Â
Successfully built 7eee4ac80c41
Successfully tagged ubuntu-docker:latest
vagrant@ubuntu-bionic:~$ sudo docker run -d --net=none --name docker3 ubuntu-docker
34713eb4d4d871a153c83ad52493616e319b44f8063d66b0d6e02eb2009cb17b
vagrant@ubuntu-bionic:~$ sudo docker run -d --net=none --name docker4 ubuntu-docker
9deea2671c303a115ceae0ffd3149318f683ba4f47adc90a96c998b75e302dfe
vagrant@ubuntu-bionic:~$ sudo docker ps
CONTAINER ID Â IMAGE Â Â Â Â Â COMMANDÂ Â Â Â CREATEDÂ Â Â Â Â STATUSÂ Â Â Â Â PORTS Â Â NAMES
9deea2671c30  ubuntu-docker  "sleep 7200"  5 seconds ago  Up 5 seconds       docker4
34713eb4d4d8  ubuntu-docker  "sleep 7200"  19 seconds ago  Up 18 seconds       docker3
āĻ¸ā§āĻā§āĻĒ - ā§§ā§āĻ āĻāĻāĻ¨ Docker Container āĻā§āĻ˛ā§āĻ¤ā§ IP āĻ¸ā§āĻ āĻāĻ°āĻžāĻ° āĻĒāĻžāĻ˛āĻžāĨ¤ āĻĒā§āĻ°āĻĨāĻŽā§ VM1 āĻāĻ° āĻ¸ā§āĻ āĻāĻĒ āĻāĻž āĻāĻ°āĻŦā§ āĻāĻ°āĻĒāĻ° VM2 āĻāĻ° āĻāĻžāĨ¤ āĻāĻ° āĻāĻ¨ā§āĻ¯ā§ āĻāĻŽāĻ°āĻž ovs-docker āĻĒā§āĻ¯āĻžāĻā§āĻ āĻĢā§āĻ¯āĻžāĻ¸āĻŋāĻ˛āĻŋāĻāĻŋ āĻāĻāĻ āĻāĻ°āĻŦā§āĨ¤ āĻ¸ā§āĻ āĻāĻ°āĻž āĻšā§ā§ āĻā§āĻ˛ā§ Container Gateway āĻ¤ā§ Container āĻĨā§āĻā§ PING āĻāĻ°ā§ āĻĻā§āĻāĻŦā§ āĻ āĻŋāĻ āĻ āĻžāĻ āĻ°āĻŋāĻĒā§āĻ˛āĻžāĻ āĻĒāĻžāĻā§āĻāĻŋ āĻāĻŋāĻ¨āĻžāĨ¤ āĻ¤ā§ āĻāĻāĻĒāĻŋ āĻ¸ā§āĻ āĻāĻ°āĻžāĻ° āĻāĻ¨ā§āĻ¯ āĻ¨āĻŋāĻā§āĻ° Command āĻā§āĻ˛ā§ āĻĻā§āĻŦā§ āĻāĻŦāĻ Log āĻā§āĻ˛ā§ āĻā§āĻāĻŋ āĻāĻ°āĻŦā§ -Â
-------------------------------- VM1 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo ovs-docker add-port ovs-br0 eth0 docker1 --ipaddress=192.168.1.11/24 --gateway=192.168.1.1
vagrant@ubuntu-bionic:~$ sudo docker exec docker1 ip a
....
18: eth0@if19: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether aa:61:11:24:f9:c6 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 192.168.1.11/24 scope global eth0
       valid_lft forever preferred_lft forever
vagrant@ubuntu-bionic:~$ sudo ovs-docker add-port ovs-br1 eth0 docker2 --ipaddress=192.168.2.11/24 --gateway=192.168.2.1
vagrant@ubuntu-bionic:~$ sudo docker exec docker2 ip a
......
20: eth0@if21: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 96:39:0e:ef:bb:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 192.168.2.11/24 scope global eth0
       valid_lft forever preferred_lft forever
vagrant@ubuntu-bionic:~$ sudo docker exec docker1 ping 192.168.1.1 -c 2
PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.
64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=0.305 ms
64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=0.099 ms
--- 192.168.1.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4208ms
rtt min/avg/max/mdev = 0.037/0.107/0.305/0.101 ms
vagrant@ubuntu-bionic:~$ sudo docker exec docker2 ping 192.168.2.1 -c 2
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
64 bytes from 192.168.2.1: icmp_seq=1 ttl=64 time=0.245 ms
64 bytes from 192.168.2.1: icmp_seq=2 ttl=64 time=0.066 ms
--- 192.168.2.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4271ms
rtt min/avg/max/mdev = 0.062/0.118/0.245/0.067 ms
-------------------------------- VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------
vagrant@ubuntu-bionic:~$ sudo ovs-docker add-port ovs-br0 eth0 docker3 --ipaddress=192.168.1.12/24 --gateway=192.168.1.1
vagrant@ubuntu-bionic:~$ sudo docker exec docker3 ip a
....
18: eth0@if19: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 4e:db:39:49:ad:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 192.168.1.12/24 scope global eth0
       valid_lft forever preferred_lft forever
vagrant@ubuntu-bionic:~$ sudo ovs-docker add-port ovs-br1 eth0 docker4 --ipaddress=192.168.2.12/24 --gateway=192.168.2.1
vagrant@ubuntu-bionic:~$ sudo docker exec docker4 ip a
.....
20: eth0@if21: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 4a:11:6d:6a:e4:a9 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet 192.168.2.12/24 scope global eth0
       valid_lft forever preferred_lft forever
vagrant@ubuntu-bionic:~$ sudo docker exec docker3 ping 192.168.1.1 -c 2
PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.
64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=0.238 ms
64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=0.045 ms
--- 192.168.1.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4084ms
rtt min/avg/max/mdev = 0.037/0.079/0.238/0.079 ms
vagrant@ubuntu-bionic:~$ sudo docker exec docker4 ping 192.168.2.1 -c 2
PING 192.168.2.1 (192.168.2.1) 56(84) bytes of data.
64 bytes from 192.168.2.1: icmp_seq=1 ttl=64 time=0.320 ms
64 bytes from 192.168.2.1: icmp_seq=2 ttl=64 time=0.093 ms
--- 192.168.2.1 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4209ms
rtt min/avg/max/mdev = 0.076/0.133/0.320/0.093 ms
āĻĻāĻžāĻ°ā§āĻŖ ... āĻāĻŽāĻ°āĻž āĻ¸āĻ āĻŋāĻ āĻāĻžāĻŦā§ IP Setup āĻāĻ°āĻ¤ā§ āĻĒā§āĻ°ā§āĻāĻŋāĨ¤ āĻāĻ° āĻĒā§āĻ°āĻŽāĻžāĻŖ āĻšāĻā§āĻā§ ... āĻ āĻŋāĻ āĻ āĻžāĻ Container āĻĨā§āĻā§ Gateway āĻ¤ā§ PING āĻĒāĻžāĻā§āĻāĻŋāĨ¤
āĻ¸ā§āĻā§āĻĒ - ā§§ā§ŽāĻ āĻāĻ āĻ¸ā§āĻā§āĻĒ āĻ āĻāĻŽāĻ°āĻž āĻāĻā§ VM āĻāĻ° Container āĻā§āĻ˛ā§āĻ° āĻŽāĻ§ā§āĻ¯ā§ VXLAN Tunneling āĻ¸ā§āĻĨāĻžāĻĒāĻ¨ āĻāĻ°āĻŦā§āĨ¤ āĻāĻ° āĻāĻ¨ā§āĻ¯ā§ āĻāĻŽāĻžāĻĻā§āĻ° VNI Key, UDP Port 4789 āĻāĻŦāĻ Remote Container IP - āĻāĻā§āĻ˛ā§ āĻ āĻŋāĻ āĻ āĻžāĻāĻāĻžāĻŦā§ āĻĻāĻŋāĻ¤ā§ āĻšāĻŦā§āĨ¤ āĻāĻŦāĻžāĻ°ā§ āĻļā§āĻ°ā§āĻ¤ā§ āĻāĻŽāĻ°āĻž VM1 āĻāĻ° āĻāĻ¨ā§āĻ¯ āĻāĻ°āĻŦā§ āĻāĻ°āĻĒāĻ° VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯āĨ¤ āĻ¨āĻŋāĻā§āĻ° āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻā§āĻ˛ā§ āĻ¸ā§āĻŦ āĻ¸ā§āĻŦ VM āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻ āĻĻā§āĻŦā§ āĻāĻŦāĻ Log āĻā§āĻ˛ā§ āĻā§āĻ āĻāĻ°āĻŦā§ -Â
-------------------------------- VM1 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo ovs-vsctl add-port ovs-br0 vxlan0 -- set interface vxlan0 type=vxlan options:remote_ip=192.168.33.11 options:key=1000
vagrant@ubuntu-bionic:~$ sudo ovs-vsctl add-port ovs-br1 vxlan1 -- set interface vxlan1 type=vxlan options:remote_ip=192.168.33.11 options:key=2000
-------------------------------- VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------
vagrant@ubuntu-bionic:~$ sudo ovs-vsctl add-port ovs-br0 vxlan0 -- set interface vxlan0 type=vxlan options:remote_ip=192.168.33.10 options:key=1000
vagrant@ubuntu-bionic:~$ sudo ovs-vsctl add-port ovs-br1 vxlan1 -- set interface vxlan1 type=vxlan options:remote_ip=192.168.33.10 options:key=2000
āĻāĻĒāĻ°ā§āĻ° Command āĻ ... āĻ¯āĻāĻ¨ VM1 āĻāĻ° āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻ āĻāĻāĻŋ āĻ¤āĻāĻ¨ remote_ip āĻāĻ° āĻā§āĻ¯āĻžāĻ˛ā§ āĻšāĻŦā§ VM2 āĻāĻ° IP Address āĻ¯ā§āĻāĻž āĻšāĻ˛ā§ 192.168.33.11āĨ¤ āĻāĻŦāĻ VM2 āĻāĻ° āĻāĻžāĻ°ā§āĻŽāĻŋāĻ¨āĻžāĻ˛ āĻ āĻ¯āĻāĻ¨ āĻāĻāĻŋ āĻ¤āĻāĻ¨ remote_ip āĻāĻ° Value āĻšāĻŦā§Â VM1 āĻāĻ° IP Address āĻ¯ā§āĻāĻž āĻšāĻ˛ā§ 192.168.33.10āĨ¤ āĻāĻā§ VM āĻāĻ vxlan0 āĻāĻ° VNI Key āĻšāĻŦā§ 1000 āĻāĻŦāĻ vxlan1 āĻāĻ° VNI Key āĻšāĻŦā§ 2000āĨ¤Â
āĻ¸ā§āĻā§āĻĒ - ā§§ā§¯āĻ āĻāĻāĻ¨ āĻāĻŽāĻ°āĻž āĻā§āĻ āĻāĻ°āĻŦā§ āĻāĻā§ VM āĻāĻ° UDP Port 4789 āĻā§āĻ¯āĻžāĻā§āĻāĻŋāĻā§āĻ āĻšā§ā§āĻā§ āĻāĻŋāĻ¨āĻž? āĻāĻāĻāĻ¸āĻžāĻĨā§ Vritual Bridge āĻāĻŦāĻ IP Address āĻāĻž āĻā§āĻ āĻāĻ°āĻŦā§āĨ¤ āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻā§āĻ˛ā§ āĻĻāĻŋā§ā§ āĻ¨āĻŋāĻā§āĻ° āĻŽāĻ¤ā§ Log āĻāĻ¸āĻā§ āĻāĻŋāĻ¨āĻž āĻā§āĻ āĻāĻ°āĻŦā§ āĨ¤Â
-------------------------------- VM1 āĻāĻŦāĻ VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ netstat -ntulp
Proto Recv-Q Send-Q Local Address      Foreign Address     State    PID/Program name
......Â
udp    0   0 0.0.0.0:4789      0.0.0.0:*              -
udp6 Â Â Â 0Â Â Â 0 :::4789 Â Â Â Â Â Â Â Â :::*Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â -
vagrant@ubuntu-bionic:~$ sudo ovs-vsctl show
81ef0a57-43f0-426a-b8c8-2541d9ef2e42
    Bridge "ovs-br1"
      ......
        Port "vxlan1"
            Interface "vxlan1"
                type: vxlan
                options: {key="2000", remote_ip="192.168.33.11"} #āĻāĻ IP Address VM2 āĻĨā§āĻā§ 192.168.33.10 āĻĻā§āĻāĻžāĻŦā§
    Bridge "ovs-br0"
        Port "vxlan0"
            Interface "vxlan0"
                type: vxlan
                options: {key="1000", remote_ip="192.168.33.11"} #āĻāĻ IP Address VM2 āĻĨā§āĻā§ 192.168.33.10 āĻĻā§āĻāĻžāĻŦā§
    ovs_version: "2.9.8"
vagrant@ubuntu-bionic:~$ sudo ip a
.....
19: 836260d20c054_l@if18: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
    link/ether ae:b4:aa:41:c1:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet6 fe80::acb4:aaff:fe41:c191/64 scope link
       valid_lft forever preferred_lft forever
21: 08b889f5f85d4_l@if20: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
    link/ether e2:d3:e3:28:72:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 1
    inet6 fe80::e0d3:e3ff:fe28:72f5/64 scope link
       valid_lft forever preferred_lft forever
22: vxlan_sys_4789: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65000 qdisc noqueue master ovs-system state UNKNOWN group default qlen 1000
    link/ether a2:3a:26:bb:81:71 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::a03a:26ff:febb:8171/64 scope link
       valid_lft forever preferred_lft forever
sudo ovs-vstl show āĻāĻ āĻāĻŽāĻžāĻ¨ā§āĻĄ āĻĻā§āĻŦāĻžāĻ° āĻĒāĻ° remote ip address āĻāĻž VM1 āĻĨā§āĻā§ āĻĻāĻŋāĻ˛ā§ VM2 āĻāĻ° IP Adress, 192.168.33.11 āĻĻā§āĻāĻžāĻŦā§ āĻāĻŦāĻ VM2 āĻĨā§āĻā§ āĻĻāĻŋāĻ˛ā§ VM1 āĻāĻ° IP Address, 192.168.33.10 āĻĻā§āĻāĻžāĻŦā§āĨ¤ āĻāĻāĻāĻĒā§āĻ Log āĻāĻ° āĻāĻŽā§āĻ¨ā§āĻ āĻāĻž āĻā§āĻ āĻāĻ°ā§āĻ¨āĨ¤Â
āĻ¸ā§āĻā§āĻĒ - ā§¨ā§ĻāĻ Moment Of Truth ... āĻāĻŦāĻžāĻ° āĻāĻŽāĻ°āĻž āĻā§āĻ āĻāĻ°āĻŦā§ Container 1 āĻĨā§āĻā§ Container 3 āĻ āĻŋāĻāĻ āĻžāĻ PING āĻāĻ°āĻ¤ā§ āĻĒāĻžāĻ°āĻž āĻ¯āĻžā§ āĻāĻŋāĻ¨āĻž? āĻāĻāĻ āĻ°āĻāĻŽ āĻāĻžāĻŦā§ Container 2 āĻĨā§āĻā§ Container 4 āĻ āĻŋāĻ PING āĻāĻ°āĻ¤ā§ āĻĒāĻžāĻ°āĻž āĻ¯āĻžā§ āĻāĻŋāĻ¨āĻž? āĻļā§āĻ°ā§āĻ¤ā§āĻ VM1 āĻāĻ° āĻāĻ¨ā§āĻ¯ āĻā§āĻ āĻāĻ°āĻŋ -Â
-------------------------------- VM1 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo docker exec docker1 ping 192.168.1.11Â # docker1 āĻĨā§āĻā§ docker1 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.1.11 (192.168.1.11) 56(84) bytes of data. Â Â Â Â Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...Â
64 bytes from 192.168.1.11: icmp_seq=1 ttl=64 time=0.015 ms
64 bytes from 192.168.1.11: icmp_seq=2 ttl=64 time=0.060 ms
....
vagrant@ubuntu-bionic:~$ sudo docker exec docker1 ping 192.168.2.11 Â # docker1 āĻĨā§āĻā§ docker2 āĻāĻ° IP āĻ¤ā§ PING
^C Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...Â
vagrant@ubuntu-bionic:~$ sudo docker exec docker1 ping 192.168.1.12 Â # docker1 āĻĨā§āĻā§ docker3 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.1.12 (192.168.1.12) 56(84) bytes of data. Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...Â
64 bytes from 192.168.1.12: icmp_seq=1 ttl=64 time=1.35 ms
64 bytes from 192.168.1.12: icmp_seq=2 ttl=64 time=1.23 ms
....
vagrant@ubuntu-bionic:~$ sudo docker exec docker1 ping 192.168.2.12Â Â # docker1 āĻĨā§āĻā§ docker4 āĻāĻ° IP āĻ¤ā§ PING
^C Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...Â
vagrant@ubuntu-bionic:~$ sudo docker exec docker2 ping 192.168.2.11 Â Â # docker2 āĻĨā§āĻā§ docker2 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.2.11 (192.168.2.11) 56(84) bytes of data.        # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...Â
64 bytes from 192.168.2.11: icmp_seq=1 ttl=64 time=0.014 ms
64 bytes from 192.168.2.11: icmp_seq=2 ttl=64 time=0.045 ms
......
vagrant@ubuntu-bionic:~$ sudo docker exec docker2 ping 192.168.2.12 Â Â # docker2 āĻĨā§āĻā§ docker4 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.2.12 (192.168.2.12) 56(84) bytes of data.        # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...Â
64 bytes from 192.168.2.12: icmp_seq=1 ttl=64 time=1.51 ms
64 bytes from 192.168.2.12: icmp_seq=2 ttl=64 time=1.06 ms
.....
vagrant@ubuntu-bionic:~$ sudo docker exec docker2 ping 192.168.1.11 Â Â # docker2 āĻĨā§āĻā§ docker1 āĻāĻ° IP āĻ¤ā§ PING
^C Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...
vagrant@ubuntu-bionic:~$ sudo docker exec docker2 ping 192.168.1.12 Â Â # docker2 āĻĨā§āĻā§ docker3 āĻāĻ° IP āĻ¤ā§ PING
^CÂ Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...
āĻāĻāĻ āĻ°āĻāĻŽ āĻāĻžāĻŦā§ VM2 āĻāĻ° Container āĻā§āĻ˛ā§ āĻĨā§āĻā§ PING āĻĻāĻŋā§ā§āĻ āĻāĻŽāĻ°āĻž āĻā§āĻˇā§āĻāĻž āĻāĻ°āĻŦā§Â -Â
-------------------------------- VM2 āĻāĻ° āĻāĻ¨ā§āĻ¯ --------------------------------Â
vagrant@ubuntu-bionic:~$ sudo docker exec docker3 ping 192.168.1.12 -c 5 Â # docker3 āĻĨā§āĻā§ docker3 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.1.12 (192.168.1.12) 56(84) bytes of data. Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ... Â
64 bytes from 192.168.1.12: icmp_seq=1 ttl=64 time=0.013 ms
... ... ...
--- 192.168.1.12 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4420ms
rtt min/avg/max/mdev = 0.013/0.039/0.059/0.018 ms
vagrant@ubuntu-bionic:~$ sudo docker exec docker3 ping 192.168.1.11 -c 5Â # docker3 āĻĨā§āĻā§ docker1 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.1.11 (192.168.1.11) 56(84) bytes of data. Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...
64 bytes from 192.168.1.11: icmp_seq=1 ttl=64 time=0.467 ms
... ... ...
--- 192.168.1.11 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4112ms
rtt min/avg/max/mdev = 0.467/1.103/1.876/0.475 ms
vagrant@ubuntu-bionic:~$ sudo docker exec docker3 ping 192.168.2.11 -c 5Â # docker3 āĻĨā§āĻā§ docker2 āĻāĻ° IP āĻ¤ā§ PING
^C Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...
vagrant@ubuntu-bionic:~$ sudo docker exec docker3 ping 192.168.2.12 -c 5Â # docker3 āĻĨā§āĻā§ docker4 āĻāĻ° IP āĻ¤ā§ PING
^C Â Â Â Â Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...
vagrant@ubuntu-bionic:~$ sudo docker exec docker4 ping 192.168.2.11 -c 5Â # docker4 āĻĨā§āĻā§ docker2 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.2.11 (192.168.2.11) 56(84) bytes of data. Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...
64 bytes from 192.168.2.11: icmp_seq=1 ttl=64 time=0.391 ms
... ... ...
--- 192.168.2.11 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4269ms
rtt min/avg/max/mdev = 0.391/0.684/1.323/0.332 ms
vagrant@ubuntu-bionic:~$ sudo docker exec docker4 ping 192.168.2.12 -c 5Â # docker4 āĻĨā§āĻā§ docker4 āĻāĻ° IP āĻ¤ā§ PING
PING 192.168.2.12 (192.168.2.12) 56(84) bytes of data.          # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ ...
64 bytes from 192.168.2.12: icmp_seq=1 ttl=64 time=0.015 ms
... ... ...
--- 192.168.2.12 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4077ms
rtt min/avg/max/mdev = 0.015/0.035/0.059/0.018 ms
vagrant@ubuntu-bionic:~$ sudo docker exec docker4 ping 192.168.1.11 -c 5 Â # docker4 āĻĨā§āĻā§ docker1 āĻāĻ° IP āĻ¤ā§ PING
^C Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...
vagrant@ubuntu-bionic:~$ sudo docker exec docker4 ping 192.168.1.12 -c 5 Â # docker4 āĻĨā§āĻā§ docker3 āĻāĻ° IP āĻ¤ā§ PING
^C Â # āĻ āĻŋāĻāĻ āĻžāĻ PING āĻĒāĻžāĻŦā§ āĻ¨āĻž ...
Bingoooo ... āĻāĻŽāĻ°āĻž āĻ āĻŋāĻ āĻ āĻžāĻ āĻāĻžāĻŦā§ VXLAN āĻ¸ā§āĻ āĻāĻĒ āĻāĻ°āĻ¤ā§ āĻĒā§āĻ°ā§āĻāĻŋāĨ¤ āĻāĻŦāĻžāĻ° āĻ¨āĻŋāĻā§ āĻ¨āĻŋāĻā§ āĻā§āĻˇā§āĻāĻž āĻāĻ°ā§āĻ¨āĨ¤ āĻĻā§āĻā§āĻ¨ āĻĒāĻžāĻ°ā§āĻ¨ āĻāĻŋāĻ¨āĻž ...Â
āĻ¯āĻĻāĻŋ PING āĻāĻ° āĻāĻŦāĻŋ āĻĻā§āĻāĻ¤ā§ āĻāĻžāĻ¨ āĻ¤āĻžāĻšāĻ˛ā§ VM-HOST-1 āĻāĻŦāĻ VM-HOST-2 āĻāĻ āĻĻā§āĻā§ āĻ˛āĻŋāĻāĻ āĻ āĻāĻŋā§ā§ āĻĻā§āĻāĻ¤ā§ āĻĒāĻžāĻ°ā§āĻ¨āĨ¤ āĻā§āĻŽ āĻ āĻā§āĻ˛āĻŋāĻ āĻāĻ°āĻ˛ā§ āĻ¸āĻŽā§āĻĒā§āĻ°ā§āĻ¨ āĻāĻŽā§āĻ āĻāĻŋ āĻĻā§āĻāĻž āĻ¯āĻžāĻŦā§āĨ¤
āĻāĻžāĻ āĻāĻž āĻāĻ°āĻ¤ā§ āĻāĻŋā§ā§ āĻŦā§āĻļ āĻāĻŋāĻā§ āĻ¸āĻŽāĻ¸ā§āĻ¯āĻžāĻ° āĻ¸āĻŽā§āĻŽā§āĻā§āĻ¨ āĻšā§ā§āĻāĻŋāĻ˛āĻžāĻŽāĨ¤ āĻ¸ā§āĻā§āĻ˛ā§āĻ° āĻ¯ā§āĻāĻžāĻŦā§ āĻ¸āĻŽāĻžāĻ§āĻžāĻ¨ āĻāĻ°ā§āĻāĻŋ āĻ¤āĻž āĻāĻ FAQ and Troubleshoot āĻĒā§āĻ āĻ āĻ˛āĻŋāĻā§āĻāĻŋāĨ¤ āĻšā§āĻ¤ā§ āĻāĻĒāĻ¨āĻžāĻ° āĻāĻžāĻā§ āĻ˛āĻžāĻāĻ¤ā§ āĻĒāĻžāĻ°ā§āĨ¤
Page updated
Google Sites
Report abuse