wiki:ForkLift

Fork-Lifting VMs on vm0.sea.rg.net from ESXI to Debian with Ganeti

With much help from https://nsrc.org/workshops/2014/sanog23-virtualization/raw-attachment/wiki/Agenda/ex-ganeti-install.htm.

And And https://nsrc.org/workshops/2014/sanog23-virtualization/wiki/Agenda is also helpful.


First, record disk and memory allocation for each VM, configured size, not utilization.

Hostname RAM Disk MAC MD5
adrilankha.hactrn.net 4G 200G 00:0c:29:be:72:5b f4566ff7105e84dabcb3f6cd2ff40ab0
archive.psg.com 1G 100G 00:0c:29:6e:06:f4 69b5cc1318707977b08ff8d7767af816
hiroshima.bogus.com 4G 250G 00:0c:29:75:01:b7 3a5f2130a23679962526a9ec5f90e8a8
linear.algebras.org 1G 100G 00:0c:29:b7:6a:60 11548e21ef24236b599cdb64878c37ac
nagasaki.bogus.com 4G 256G 00:0c:29:6b:64:e3 3f4b06082516e89a8e7dcb5e6bb072a7
okui.psg.com 1G 100G 00:0c:29:89:e3:60 aabd3b496a131e8f516a3c541a04a78f
r1.securerouting.org 2G 100G 00:0c:29:46:0e:b6 a108b9201bf853868f9c462513af3c20
rip1.psg.com 2G 36G 00:0c:29:60:fe:bb ce7da43bbcc25ed2b45a4458aaaf943c
turing.worldpowersystems.com 2G 256G* 00:0c:29:b7:21:6e 03dce3e51df1d3e2fe880fbd852cf9e5
zoe.dns.gh 4G 200G 00:0c:29:9e:36:a2 86c24decf3c0a46aa830586d0df2ca74
zzyzx.sigpipe.org 2G 100G 00:0c:29:bf:79:86 7eef30eb2de95e5d38d491b78df0c9cb

Users Hack Configuration Aspects Which Will Change

Disk and Network Interface naming may change from the ESXI guest environment to the Ganeti/KVM environment. Owners of gusts should make config changes just before shutting down their machines. Thus, when they come back up in the new environment they will boot usefully.

Linux Guests Should Need No Modification

Linux Guests should be able to find their disks as UUIDs and mount as /dev/sdaN. And Ethernet seems to be a pretty constant eth0.

FreeBSD Guests May Need Modification

Do not do this. There seems to be a hack around it, see below.

FreeBSD guests seem to use /dev/ada for the disk drives

root@fbsd0:~ # more /etc/fstab
# Device        Mountpoint      FStype  Options Dump    Pass#
/dev/ada0p2     /               ufs     rw      1       1
/dev/ada0p3     none            swap    sw      0       0

FreeBSD drives on ESXI seem to be /dev/da. So users will have to change their /etc/fstab just before the fork-lift. s/da/ada/g

The FreeBSD Ethernet interface seems to be em0 on ESXI and on KVM

root@fbsd0:~ # ifconfig 
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
        ether 52:54:00:ad:71:03
        inet 198.180.150.10 netmask 0xffffff00 broadcast 198.180.150.255
        inet6 fe80::5054:ff:fead:7103%em0 prefixlen 64 scopeid 0x2 
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active

As ESXI and KVM seem to be the same, it should require no change.

Copy VMs to an NFS Mounted Filesystem

Create a /data/nfs directory on raid1.psg.com and NFS export it to vm0.sea using hacks/advice from:

Mount raid1.psg.com:/data/nfs on vm0.sea.rg.net as an NFS datastore.

Stop and power off all guest VMs on vm0.sea.rg.net.

Record the md5 checksum of each and every guest VM .vmdk file.

Use VMware vSphere Client on my laptop to move each guest VM from vm0.sea.rg.net:datastore1 to the NFS datastore.

Take the md5 checksum of each and every .vmdk file on the NFS datastore and compare to that of the original from vm0.sea.rg.net:datastore1.

It is now safe to destroy and rebuild vm0.sea.rg.net

Build a Debian/Ganeti System on vm0.sea.rg.net

Boot into Adaptec BIOS and configure the four drives as one RAID5. The hack to get an INSert key on the MacBook? is Windows, Accessories, Access, Keyboard

Install Debian

  • Boot Debian CD/ISO
  • Choose Install
  • Choose English, UK (so you can get UCT)
  • Choose American English
  • Name the host
  • Choose root password
  • Choose user name and password
  • Partition
    • Choose Manual Partitioning
    • Select the drive
    • Create new empty partition table
    • Select Free Space
    • Create new partition, primary, 1GB, begining, bios
    • Done
    • Select Free Space
    • Create new partition, primary, 256MGB, begining, /boot, ext4, bootable
    • Done
    • Select Free Space again
    • Create a new partition
    • Accept whatever size is shown (the rest of the disk)
    • Primary, physical volume for LVM
    • Done
  • Configure LVM
    • Configure LVM accepting write changes to disks
    • Create volume group
      • Volume group name: ganeti
      • Devices for the new volume group: select only the LVM partition
    • Create Logical Volume: on ganeti, root, 8G
    • Create Logical Volume: on ganeti, swap, 16G
    • Create Logical Volume: on ganeti, var, 8G
    • Edit the Logical Volumes to be ext4 /, swap, and ext4 /var
    • Finish partitioning and write changes
  • Finish partitioning and write changes to disk
  • Be sure it will not boot CD-ROM, and Reboot from the installed system

Finish Debian Installation

Clean up from CDROM sources

vi /etc/apt/sources.list

and delete the two CDROM entries at the top

Install homey things (it's not a computer without emacs:)

apt-get update
apt-get upgrade
apt-get install emacs23-nox
apt-get install rsync
apt-get install gcc
apt-get install bridge-utils vlan
apt-get install sudo
apt-get install unbound
apt-get install tw_cli   ***********
usermod -G sudo -a randy

Fix hostname

echo vm0.sea.rg.net > /etc/hostname
hostname `cat /etc/hostname`

Fix /etc/unbound/unbound.conf

        access-control: 127.0.0.0/8 allow
        access-control: 147.28.0.0/16 allow
        access-control: 198.180.150.0/24 allow
        access-control: 198.180.152.0/24 allow
        access-control: 0.0.0.0/0 refuse
        access-control: ::1 allow
        access-control: ::ffff:127.0.0.1 allow
        access-control: 2001:418:1::0/48 allow
        access-control: 2001:418:3807::0/48 allow
        access-control: 2001:418:8006::0/48 allow
        access-control: ::0/0 refuse

Install Unattended Upgrading

Debian Ganeti Specific Configuration

Edit /etc/hosts to have the real address of the host, e.g.

127.0.0.1       localhost
147.28.0.3      vm0.sea.rg.net  vm0
147.28.0.100    gnt0.sea.rg.net

Fix /etc/network/interfaces

Make eth0 hang off of whatever your bridge will be called

# The loopback network interface
auto lo
iface lo inet loopback

# Management interface
auto eth0
iface eth0 inet manual

auto br-lan
iface br-lan inet static
        address         147.28.0.3
        netmask         255.255.255.0
        gateway         147.28.0.1
        bridge_ports    eth0
        bridge_stp      off
        bridge_fd       0
        bridge_maxwait  0

# VLAN 100
auto eth0.100
iface eth0.100 inet manual

auto br-rep
iface br-rep inet static
        address         147.28.0.100
        netmask         255.255.255.0
        bridge_ports    eth0.100
        bridge_stp      off
        bridge_fd       0
        bridge_maxwait  0

auto eth0.255
iface eth0.255 inet manual

# VLAN 255
auto br-svc
iface br-svc inet manual
        bridge_ports    eth0.255
        bridge_stp      off
        bridge_fd       0
        bridge_maxwait  0

Check /etc.resolv.comf

In theory, this looks like

               -------------+--------------
                            |
                          br-lan 
                            |         this host
                  +---------+---------+
                  |        eth0       |
                  |                   |
                  |eth0.255   eth0.100|
                  +--+-----------+----+
                     |           |
                   br-svc      br-rep
                     |           |
         VMs --------+           +------> to other ganeti hosts

Install Ganeti

Set up to get Ganeti from backports

cat > /etc/apt/sources.list.d/wheezy-backports.list
deb http://cdn.debian.net/debian/ wheezy-backports main

And then install it

apt-get update
apt-get install ganeti/wheezy-backports

Fix up drbd

echo "options drbd minor_count=128 usermode_helper=/bin/true" > /etc/modprobe.d/drbd.conf
rmmod drbd      # ignore any error
modprobe drbd

Initialize and Build Ganeti Cluster

gnt-cluster init \
  --master-netdev=br-lan \
  --enabled-hypervisors=kvm \
  -H kvm:kernel_path="",initrd_path="" \
  -N link=br-lan \
  --vg-name=ganeti \
  gnt0.sea.rg.net

If it barfs, try

gnt-cluster destroy --yes-do-it

then re-run gnt-cluster init ...

If you get into gnutls problems check apt-get upgrade and dist-upgrade

Check That CLuster is Happy

Fix VNC passwording

echo '4titude' > /etc/ganeti/vnc-cluster-password
gnt-cluster modify -H kvm:vnc_password_file=/etc/ganeti/vnc-cluster-password

Test that the cluster was built happily

gnt-cluster verify

If you get

Fri Mar 14 05:20:55 2014   - ERROR: node deb64.psg.com: volume ganeti/root is unknown
Fri Mar 14 05:20:55 2014   - ERROR: node deb64.psg.com: volume ganeti/swap is unknown
Fri Mar 14 05:20:55 2014   - ERROR: node deb64.psg.com: volume ganeti/var is unknown

That's OK. To make it go away

gnt-cluster modify --reserved-lvs=ganeti/root,ganeti/swap,ganeti/var

Load the ESXI Images

Make a LV for the ESXI images

lvcreate --size 2TB --name nfs-data ganeti
mkfs.ext4 /dev/ganeti/nfs-data
mkdir /nfs-data
mount /dev/ganeti/nfs-data /nfs-data

Copy over the data from raid1. rsync and scp are compute bound. nfs and ftp may be the best choices

Install Ganeti Instance Management

Install ganeti-instance-image

wget https://code.osuosl.org/attachments/download/2169/ganeti-instance-image_0.5.1-1_all.debcd
dpkg -i ganeti-instance-image_0.5.1-1_all.deb

Install qemu utilities (though they likely came in with other installs)

apt-get install qemu-utils

And force latest version of qemu-image

apt-get install qemu-utils/wheezy-backports

Aside: if you also want ganeti-instance-debootstrap then version 0.14 is now in wheezy-backports. You don't need to install from source. You'll only want ganeti-instance-debootstrap to create images from scratch where it installs Debian or a Debian-related OS automatically.

Create the Guest VM Instances

For each VM, run the following:

#!/bin/sh

# makeVM diskGB ramGB nameFQDN

DISK=$1
RAM=$2
NAME=$3
NODE=vm0.sea.rg.net

gnt-instance add \
     -t plain \
     -o image+default \
     -s ${DISK}G \
     -B minmem=${RAM}G,maxmem=$((${RAM}*2))G \
     -n $NODE \
     -H kvm:vnc_bind_address=0.0.0.0 \
     --no-install \
     --no-start \
     --no-ip-check \
     --no-name-check \
     ${NAME}

This produces

vm0.sea.rg.net:/root# ./do-add 200 4 <instance-name>
Tue Apr 22 23:15:35 2014 * disk 0, size 200.0G
Tue Apr 22 23:15:35 2014 * creating instance disks...
Tue Apr 22 23:15:38 2014 adding instance <instance-name> to cluster config
Tue Apr 22 23:15:38 2014  - INFO: Waiting for instance <instance-name> to sync disks
Tue Apr 22 23:15:39 2014  - INFO: Instance <instance-name>'s disks are in sync

If it is a FreeBSD VM, also do

gnt-instance modify -H disk_type=scsi <instance-name>

so that da devices still work at boot.

Get the UUIDs of all VMs, and fill out the table.

gnt-instance list -o name,disk.uuid/0

Get the Stored VM VMDK Files from Backup

As root

mkdir -p /store/esxi-vms
rsync -vPaHxRSz raid1.psg.com:/data/nfs/<vmname> /store/esxi-vms

Again, compare the MD5 checksums of the vmdk files with that of the the originals.

Convert the ESXI Images to Ganeti Guest Images

gnt-instance info --all | egrep 'Instance name|on primary'

Will show the primary device for each ganeti VM

      on primary: /dev/xenvg/95d2bb8f-063f-498d-b98a-9c03acea991f.disk0 (252:2)

which we use as the output UUID

Check the type of image we have

qemu-img info <vmdk-filename>

If it is a Flat Raw Image

For -flat.vmdk files, you should be able to

dd bs=4096k if=<vmdk-filename> of=/dev/ganeti/<disk0 from gnt-instance info>

If it is a Real VMDK

For -s001.vmdk files, then you should be able, for each VMDK

qemu-img convert -f vmdk -O raw <input_file> <output UUID>

Try the VMs!

You can use the built in console or come over VNC 9over ssh, of course).

Start the image

gnt instance start <image name>

And come im over the text console or VNC

Direct Text Console

gnt-instance console <image name>

Over VNC for Graphics

gnt-instance list -o +network_port

To get

Instance     Hypervisor OS            Primary_node  Status  Memory Network_port
minibsd-test kvm        image+default deb64.psg.com running   256M 11001

Then run a VNC to the base system port number in that report e.g. 11001, e.g. (notice port 11001)

ssh -N -L 5900:127.0.0.1:11001 vm0.sea.rg.net

And get ready to start your VNC session (in this case, I would be using Chicken of the VNC to VNC display localhost:0, aka localhost port 5900).

To give each user a different password, do it at the instance level:

echo 'wombat' >/etc/ganeti/vnc-password-<username>
gnt-instance modify -H vnc_password_file=/etc/ganeti/vnc-password-<username> foobar

Or make a directory /etc/ganeti/passwords and stash them there.

If FreeBSD Does Not Mount Root

If the system boots but does did not mount the root filesystem, and leaves you at the mountroot prompt. It seems as if FreeBSD

/dev/da0p2

may become

/dev/vtbd0p2

If you do the mountroot to

ufs:/dev/vtbd0p2

the root mounts and the system comes up.

sra reminds us that it is good idea to do an fsck of / at single user, before enabling write to the / filesystem.

Of course, the filesystem will be image dependent.

Optionally Convert plain to drbd

For each instance

$ gnt-instance stop <instance name>
$ gnt-instance modify \
    -t drbd \
    --no-wait-for-sync \
    <instance name>
$ gnt-instance start <instance name>

The ESXI Images as of 2014.04.18

/vmfs/volumes/4d794907-845289f0-6305-003048d66e3b # ls -lh *
ISOs:
-rw-------    1 root     root       690.6M Apr 16  2011 FreeBSD-8.2-RELEASE-amd64-disc1.iso
-rw-------    1 root     root       612.1M Mar  8  2012 FreeBSD-9.0-RELEASE-amd64-disc1.iso
-rw-------    1 root     root       684.2M Apr 20  2011 ubuntu-10.04.2-server-amd64.iso

Patches:
-rw-------    1 root     root       202.1M Mar 10  2011 ESXi410-201010001.zip
-rw-------    1 root     root        85.7M Mar 10  2011 ESXi410-201011001.zip
-rw-------    1 root     root       205.0M Jul 19  2011 ESXi410-201104001.zip
-rw-------    1 root     root       205.8M Jul 19  2011 update-from-esxi4.1-4.1_update01.zip

Zoe 147.28.0.23:
-rw-------    1 root     root         4.0G Aug 20  2012 Zoe 147.28.0.23-cc6d5f9f.vswp
-rw-------    1 root     root       200.0G Apr 19 00:58 Zoe 147.28.0.23-flat.vmdk
-rw-------    1 root     root         8.5k Mar  7 02:28 Zoe 147.28.0.23.nvram
-rw-------    1 root     root          504 Jul  7  2011 Zoe 147.28.0.23.vmdk
-rw-r--r--    1 root     root            0 Jul  7  2011 Zoe 147.28.0.23.vmsd
-rwxr-xr-x    1 root     root         2.8k Feb 21  2012 Zoe 147.28.0.23.vmx
-rw-r--r--    1 root     root          270 Mar  8  2012 Zoe 147.28.0.23.vmxf
-rw-r--r--    1 root     root        45.7k Feb 21  2012 vmware-10.log
-rw-r--r--    1 root     root        46.6k Feb 21  2012 vmware-11.log
-rw-r--r--    1 root     root        56.5k Feb 21  2012 vmware-12.log
-rw-r--r--    1 root     root        45.3k Aug 18  2012 vmware-13.log
-rw-r--r--    1 root     root        71.4k Feb 20  2012 vmware-8.log
-rw-r--r--    1 root     root        45.6k Feb 20  2012 vmware-9.log
-rw-r--r--    1 root     root        45.5k Feb 12 03:05 vmware.log

adrilankha.hactrn.net:
-rw-------    1 root     root         4.0G Aug 20  2012 adrilankha.hactrn.net-597d4fbe.vswp
-rw-------    1 root     root       256.0G Apr 19 00:58 adrilankha.hactrn.net-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:40 adrilankha.hactrn.net.nvram
-rw-------    1 root     root          484 Jul 16  2011 adrilankha.hactrn.net.vmdk
-rw-r--r--    1 root     root            0 Jul 16  2011 adrilankha.hactrn.net.vmsd
-rwxr-xr-x    1 root     root         2.9k May 16  2012 adrilankha.hactrn.net.vmx
-rw-r--r--    1 root     root          276 Mar 16 18:11 adrilankha.hactrn.net.vmxf
-rw-r--r--    1 root     root        44.0k Jul 16  2011 vmware-1.log
-rw-r--r--    1 root     root        70.7k Jul 17  2011 vmware-2.log
-rw-r--r--    1 root     root       322.9k May 16  2012 vmware-3.log
-rw-r--r--    1 root     root       121.1k Aug  8  2012 vmware-4.log
-rw-r--r--    1 root     root        55.4k Aug 20  2012 vmware-5.log
-rw-r--r--    1 root     root       548.3k Apr  8 05:11 vmware.log

apnicrpki.rand.apnic.net:
-rw-------    1 root     root         1.0G Apr 10  2013 apnicrpki.rand.apnic.net-c157c72e.vswp
-rw-r--r--    1 root     root         6.7G Apr 19 00:58 apnicrpki.rand.apnic.net-s001.vmdk
-rw-------    1 root     root         8.5k Mar 19 03:20 apnicrpki.rand.apnic.net.nvram
-rw-------    1 root     root          717 Mar 11  2011 apnicrpki.rand.apnic.net.vmdk
-rw-r--r--    1 root     root            0 Mar 11  2011 apnicrpki.rand.apnic.net.vmsd
-rwxr-xr-x    1 root     root         2.7k Mar 11  2011 apnicrpki.rand.apnic.net.vmx
-rw-r--r--    1 root     root          279 Mar 11  2011 apnicrpki.rand.apnic.net.vmxf
-rw-r--r--    1 root     root        99.1k Apr 17  2011 vmware-1.log
-rw-r--r--    1 root     root        61.0k Apr 30  2011 vmware-2.log
-rw-r--r--    1 root     root        83.6k Jul 15  2011 vmware-3.log
-rw-r--r--    1 root     root        60.9k Aug  1  2011 vmware-4.log
-rw-r--r--    1 root     root       164.1k Aug 18  2012 vmware-5.log
-rw-r--r--    1 root     root        68.2k Aug 20  2012 vmware-6.log
-rw-r--r--    1 root     root       152.1k Apr 16 13:32 vmware.log

archive.psg.com:
-rw-------    1 root     root         1.0G Apr  8  2013 archive.psg.com-7275f553.vswp
-rw-------    1 root     root       100.0G Apr 19 00:57 archive.psg.com-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:46 archive.psg.com.nvram
-rw-------    1 root     root          478 Jun 26  2011 archive.psg.com.vmdk
-rw-r--r--    1 root     root            0 Jun 26  2011 archive.psg.com.vmsd
-rwxr-xr-x    1 root     root         2.7k Jun 26  2011 archive.psg.com.vmx
-rw-r--r--    1 root     root          270 Jun 26  2011 archive.psg.com.vmxf
-rw-r--r--    1 root     root       119.6k Jun 27  2011 vmware-1.log
-rw-r--r--    1 root     root        44.3k Jul 15  2011 vmware-2.log
-rw-r--r--    1 root     root       184.6k Jan 23  2012 vmware-3.log
-rw-r--r--    1 root     root        48.0k Aug 20  2012 vmware-4.log
-rw-r--r--    1 root     root        70.5k Apr  8 08:16 vmware.log

hiroshima.bogus.com:
-rw-------    1 root     root         4.0G Aug 20  2012 hiroshima.bogus.com-e1c80ccb.vswp
-rw-------    1 root     root       250.0G Apr 19 00:58 hiroshima.bogus.com-flat.vmdk
-rw-------    1 root     root         8.5k Apr 16 08:31 hiroshima.bogus.com.nvram
-rw-------    1 root     root          482 Mar 18  2011 hiroshima.bogus.com.vmdk
-rw-r--r--    1 root     root            0 Mar 18  2011 hiroshima.bogus.com.vmsd
-rwxr-xr-x    1 root     root         3.0k Aug  1  2011 hiroshima.bogus.com.vmx
-rw-r--r--    1 root     root          274 Aug  1  2011 hiroshima.bogus.com.vmxf
-rw-r--r--    1 root     root       160.4k Jul  2  2011 vmware-2.log
-rw-r--r--    1 root     root       266.3k Jul  4  2011 vmware-3.log
-rw-r--r--    1 root     root       119.5k Jul 15  2011 vmware-4.log
-rw-r--r--    1 root     root       106.6k Aug  1  2011 vmware-5.log
-rw-r--r--    1 root     root        47.5k Aug  1  2011 vmware-6.log
-rw-r--r--    1 root     root        47.0k Aug 18  2012 vmware-7.log
-rw-r--r--    1 root     root        45.8k Apr 17 10:44 vmware.log

linear.algebras.org:
-rw-------    1 root     root         1.0G Mar  8  2013 linear.algebras.org-3e70db4c.vswp
-rw-------    1 root     root       100.0G Apr 19 00:56 linear.algebras.org-flat.vmdk
-rw-------    1 root     root         8.5k Mar  8  2012 linear.algebras.org.nvram
-rw-------    1 root     root          482 Mar  8  2012 linear.algebras.org.vmdk
-rw-r--r--    1 root     root            0 Mar  8  2012 linear.algebras.org.vmsd
-rwxr-xr-x    1 root     root         2.9k Mar  8  2012 linear.algebras.org.vmx
-rw-r--r--    1 root     root          274 Mar  8  2012 linear.algebras.org.vmxf
-rw-r--r--    1 root     root        57.7k Mar  8  2012 vmware-1.log
-rw-r--r--    1 root     root        60.5k Aug 20  2012 vmware-2.log
-rw-r--r--    1 root     root        95.8k Jan 15 04:00 vmware.log

nagasaki.bogus.com:
-rw-------    1 root     root         2.0G Mar 15 07:21 nagasaki.bogus.com-8a19c006.vswp
-rw-------    1 root     root       256.0G Apr 19 00:58 nagasaki.bogus.com-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:55 nagasaki.bogus.com.nvram
-rw-------    1 root     root          504 Mar 21  2011 nagasaki.bogus.com.vmdk
-rw-r--r--    1 root     root            0 Mar 18  2011 nagasaki.bogus.com.vmsd
-rwxr-xr-x    1 root     root         3.3k Mar 15 07:21 nagasaki.bogus.com.vmx
-rw-r--r--    1 root     root          273 Mar 15 07:21 nagasaki.bogus.com.vmxf
-rw-r--r--    1 root     root       113.6k Apr 28  2011 vmware-15.log
-rw-r--r--    1 root     root        85.3k Jul  2  2011 vmware-16.log
-rw-r--r--    1 root     root        54.0k Jul 15  2011 vmware-17.log
-rw-r--r--    1 root     root        54.6k Aug  1  2011 vmware-18.log
-rw-r--r--    1 root     root        57.5k Aug 18  2012 vmware-19.log
-rw-r--r--    1 root     root       130.7k Mar 15 07:19 vmware-20.log
-rw-r--r--    1 root     root        47.2k Mar 15 07:32 vmware.log

okui.psg.com:
-rw-------    1 root     root         1.0G Apr 10  2013 okui.psg.com-22fd1f29.vswp
-rw-------    1 root     root       100.0G Apr 19 00:57 okui.psg.com-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:36 okui.psg.com.nvram
-rw-------    1 root     root          475 Mar  8  2012 okui.psg.com.vmdk
-rw-r--r--    1 root     root            0 Mar  8  2012 okui.psg.com.vmsd
-rwxr-xr-x    1 root     root         2.7k Mar  8  2012 okui.psg.com.vmx
-rw-r--r--    1 root     root          267 Mar  8  2012 okui.psg.com.vmxf
-rw-r--r--    1 root     root        55.2k Mar  8  2012 vmware-1.log
-rw-r--r--    1 root     root        59.9k Aug 20  2012 vmware-2.log
-rw-r--r--    1 root     root       270.2k Mar 18 00:36 vmware.log

r1.securerouting.org:
-rw-------    1 root     root         2.0G Apr 10  2013 r1.securerouting.org-66616b62.vswp
-rw-------    1 root     root       100.0G Apr 19 00:58 r1.securerouting.org-flat.vmdk
-rw-------    1 root     root         8.5k Mar 13 02:28 r1.securerouting.org.nvram
-rw-------    1 root     root          483 Jun 14  2011 r1.securerouting.org.vmdk
-rw-r--r--    1 root     root            0 Jun 14  2011 r1.securerouting.org.vmsd
-rwxr-xr-x    1 root     root         2.8k Oct 28  2011 r1.securerouting.org.vmx
-rw-r--r--    1 root     root          275 Jun 14  2011 r1.securerouting.org.vmxf
-rw-r--r--    1 root     root       129.9k Jul 10  2011 vmware-1.log
-rw-r--r--    1 root     root        55.6k Jul 15  2011 vmware-2.log
-rw-r--r--    1 root     root       132.2k Oct 28  2011 vmware-3.log
-rw-r--r--    1 root     root       303.8k Jun 15  2012 vmware-4.log
-rw-r--r--    1 root     root        59.0k Aug 18  2012 vmware-5.log
-rw-r--r--    1 root     root       254.3k Mar 13 02:29 vmware.log

rip1.psg.com:
-rw-------    1 root     root         2.0G Apr  9  2013 rip1.psg.com-1bb03eed.vswp
-rw-------    1 root     root        36.0G Apr 19 00:58 rip1.psg.com-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:32 rip1.psg.com.nvram
-rw-------    1 root     root          505 Mar 11  2011 rip1.psg.com.vmdk
-rw-r--r--    1 root     root            0 Mar 11  2011 rip1.psg.com.vmsd
-rwxr-xr-x    1 root     root         2.7k Mar 18  2011 rip1.psg.com.vmx
-rw-r--r--    1 root     root          267 Mar 18  2011 rip1.psg.com.vmxf
-rw-r--r--    1 root     root       125.3k Apr 14  2011 vmware-4.log
-rw-r--r--    1 root     root        44.4k Apr 18  2011 vmware-5.log
-rw-r--r--    1 root     root        44.3k Apr 30  2011 vmware-6.log
-rw-r--r--    1 root     root        44.2k Jul 15  2011 vmware-7.log
-rw-r--r--    1 root     root       125.9k Jan 24  2012 vmware-8.log
-rw-r--r--    1 root     root        47.5k Aug 20  2012 vmware-9.log
-rw-r--r--    1 root     root        57.7k Nov 27  2012 vmware.log

turing.wps.com:
-rw-------    1 root     root         2.0G Apr 10  2013 turing.wps.com-2cfaf03a.vswp
-rw-------    1 root     root       100.0G Apr 19 00:58 turing.wps.com-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:55 turing.wps.com.nvram
-rw-------    1 root     root          477 Apr 20  2011 turing.wps.com.vmdk
-rw-r--r--    1 root     root            0 Apr 20  2011 turing.wps.com.vmsd
-rwxr-xr-x    1 root     root         2.7k Apr 20  2011 turing.wps.com.vmx
-rw-r--r--    1 root     root          269 Apr 20  2011 turing.wps.com.vmxf
-rw-r--r--    1 root     root       154.1k Apr 29  2011 vmware-1.log
-rw-r--r--    1 root     root       396.1k May 26  2011 vmware-2.log
-rw-r--r--    1 root     root        56.1k Jul 15  2011 vmware-3.log
-rw-r--r--    1 root     root        59.2k Feb 28  2012 vmware-4.log
-rw-r--r--    1 root     root        56.8k Feb 28  2012 vmware-5.log
-rw-r--r--    1 root     root        58.6k Aug 18  2012 vmware-6.log
-rw-r--r--    1 root     root        58.7k Dec  1 10:42 vmware.log

zzyzx.sigpipe.org:
-rw-r--r--    1 root     root        77.5k Jun 13  2011 vmware-1.log
-rw-r--r--    1 root     root       133.0k Jun 13  2011 vmware-2.log
-rw-r--r--    1 root     root        56.1k Jul 15  2011 vmware-3.log
-rw-r--r--    1 root     root        55.6k Aug  1  2011 vmware-4.log
-rw-r--r--    1 root     root        58.9k Aug 18  2012 vmware-5.log
-rw-r--r--    1 root     root       145.3k Jan  2 18:49 vmware.log
-rw-------    1 root     root         2.0G Oct 24  2012 zzyzx.sigpipe.org-45c519e0.vswp
-rw-------    1 root     root       100.0G Apr 19 00:58 zzyzx.sigpipe.org-flat.vmdk
-rw-------    1 root     root         8.5k Apr 19 00:57 zzyzx.sigpipe.org.nvram
-rw-------    1 root     root          480 Jun 13  2011 zzyzx.sigpipe.org.vmdk
-rw-r--r--    1 root     root            0 Jun 13  2011 zzyzx.sigpipe.org.vmsd
-rwxr-xr-x    1 root     root         2.8k Jun 13  2011 zzyzx.sigpipe.org.vmx
-rw-r--r--    1 root     root          272 Jun 13  2011 zzyzx.sigpipe.org.vmxf
Last modified 5 years ago Last modified on Mar 20, 2015, 9:48:57 PM