Graph Visualization File Formats…

I know the following graph visualization. If you know anymore please add the to the list:

1. dot

2. fdp

3. neato

4. graphml

5. gml

6.  ygf

Upgrade Ubuntu from Edgy to Feisty

http://www.ubuntugeek.com/upgrade-ubuntu-610-edgy-eft-to-ubuntu-704-feisty-fawn-2.html

Method 2 – Using apt-get

Edit your /etc/apt/sources.list as root. Change every occurrence of edgy to feisty.

Use any prefered editor. If you have a CD-ROM line in your file, then remove it.

sudo vi /etc/apt/sources.list

or

use the following Simple command

sudo sed -e ’s/\edgy/ feisty/g’ -i /etc/apt/sources.list

Now you need to update the source list using the following command

sudo apt-get update

Upgrade using the following command

sudo apt-get dist-upgrade

Double check your process was finished properly using the following commd

sudo apt-get -f install

sudo dpkg –configure -a

Now you need to Reboot your machine to take your new ubuntu 7.04 installation to effect all changes.

Testing Your Upgrade

You can check the ubuntu version installed using the following command

sudo lsb_release -a

Output Looks like below

Distributor ID: Ubuntu
Description: Ubuntu feisty (development branch)
Release: 7.04
Codename: feisty

or

Just type the following command in your terminal

cat /etc/issue

Output Lokks like below

Ubuntu feisty (development branch) \n \l

Reality Mining Queries…

Time Analyzed: 2004-09-01 to 2004-11-30

Query to check the most active users within this time period:

mysql> select person_oid,count(distinct device_oid) as count from devicespan where device_oid in (select oid from device where person_oid>0) and (starttime > ‘2004-09-07 00:00:00′ and endtime < ‘2005-05-04 24::00′) group by person_oid order by count desc limit 10;
+————+——-+
| person_oid | count |
+————+——-+
| 29 | 101 |
| 57 | 97 |
| 86 | 95 |
| 39 | 95 |
| 43 | 93 |
| 96 | 93 |
| 95 | 92 |
| 14 | 87 |
| 16 | 84 |
| 59 | 82 |
+————+——-+
10 rows in set, 1 warning (1.87 sec)

Now we will just check these 10 users.

All Mondays in the Time period:

2004-09-06
2004-09-13
2004-09-20
2004-09-27
2004-10-04
2004-10-11
2004-10-18
2004-10-25
2004-11-01
2004-11-08
2004-11-15
2004-11-22
2004-11-29
2004-12-06
2004-12-13
2004-12-20
2004-12-27

All Tuesdays in the time period:

2004-09-07
2004-09-14
2004-09-21
2004-09-28
2004-10-05
2004-10-12
2004-10-19
2004-10-26
2004-11-02
2004-11-09
2004-11-16
2004-11-23
2004-11-30
2004-12-07
2004-12-14
2004-12-21
2004-12-28

All Wednesday in the time period:

2004-09-08
2004-09-15
2004-09-22
2004-09-29
2004-10-06
2004-10-13
2004-10-20
2004-10-27
2004-11-03
2004-11-10
2004-11-17
2004-11-24
2004-12-01
2004-12-08
2004-12-15
2004-12-22
2004-12-29

Query to check the contact in date and time:

select person_oid,device_oid, starttime,endtime from devicespan where person_oid = 29 and device_oid in (select oid from device where person_oid>0) and (starttime > ‘2004-09-13 06:00:00′ and endtime < ‘2004-09-13 12:00:00′);

Find the core nodes: People who are interacting the most:

mysql> SELECT person_oid, device_oid, COUNT(*) tot FROM devicespan where device_oid in (select oid from device where person_oid>0)and (starttime > ‘2004-09-01 00:00:00′ and endtime < ‘2005-05-30 24:00:00′) GROUP BY person_oid, device_oid order by tot desc limit 10;
+————+————+—–+
| person_oid | device_oid | tot |
+————+————+—–+
| 94 | 15 | 584 |
| 57 | 91 | 543 |
| 57 | 30 | 509 |
| 39 | 102 | 483 |
| 57 | 102 | 462 |
| 86 | 61 | 445 |
| 14 | 102 | 412 |
| 39 | 30 | 405 |
| 95 | 30 | 385 |
| 29 | 61 | 383 |
+————+————+—–+
10 rows in set, 1 warning (1.97 sec)

Some Useful queries:

select WEEKDAY(starttime), SUBTIME(time(starttime),time(endtime)) from devicespan limit 200;

Weekday = number of the weekday.
Time = to convert date-time format to time only.
Subtime = subtract the two times.

Create a view for devisespan table with weekdays and time of inetraction:

create view data_view as select person_oid, device_oid, starttime, endtime, WEEKDAY(starttime) weekday, SUBTIME(time(endtime),time(starttime)) as timediff from devicespan where time(starttime) > ‘06:00:00′ and time(starttime) 0)and (starttime > ‘2004-09-01 00:00:00′ and endtime < ‘2004-12-30 24:00:00′) GROUP BY person_oid, device_oid order by tot;

Installing MySql on Ubuntu Linux

fawad@fawad-desktop:~$ sudo apt-get install mysql-server

fawad@fawad-desktop:~$ mysqladmin -u root password 123456

fawad@fawad-desktop:~$ mysql -u root -p

mysql> CREATE DATABASE realitymining;
Query OK, 1 row affected (0.00 sec)

Experience While Copying a 42GB file into a Seagate USB Hardrive in Ubuntu Linux…

First of all i will split the file into 10GB pieces. The file name is: enwiki-20070908-stub-meta-history.xml

fawad@crete:~/wiki$ split -b 4000m enwiki-20070908-stub-meta-history.xml

Now i will copy a piece by piece into my seagate external hardrive. I am copying this file from a remote server to my machine

root@fawad-laptop:/home/fawad# scp fawad@crete.ex.nii.ac.jp:/home/fawad/wiki/enwiki-20070908-stub-meta-history.xml /media/usb0/niidata/split/
fawad@crete.ex.nii.ac.jp’s password:
enwiki-20070908-stub-meta-history.xml 10% 4091MB 10.5MB/s 57:03 ETAFile size limit exceeded (core dumped)
This means only files less than 4GB are supported. So i again spilled the files to 4GB file each.

Another important thing to note is that i had to use root login to copy file to my external seagate USB hardrive.

Now once i have splited the files into 4GB chunks. Now use the following command to copy all the files from this folder to one of the folder in the seagate harddrive.

root@fawad-laptop:/home/fawad# scp -r fawad@crete.ex.nii.ac.jp:/home/fawad/wiki/wikidata/ /media/usb0/niidata/wikifawad@crete.ex.nii.ac.jp’s password:
.nfs0000000000d5005100000001                                                               100%  435MB  10.6MB/s   00:41
xad                                                                                         27% 1101MB   9.5MB/s   05:05 ETARead from remote host crete.ex.nii.ac.jp: Connection reset by peer
xad                                                                                        100% 4000MB   9.8MB/s   06:49
xag                                                                                        100% 1233MB   9.8MB/s   02:06
xac                                                                                         38% 1522MB  10.6MB/s   03:53 ETAh
xac                                                                                         43% 1734MB  11.1MB/s   03:25 ETA
xac                                                                                        100% 4000MB  10.1MB/s   06:38
xaf                                                                                        100% 4000MB  10.2MB/s   06:32
xae                                                                                        100% 4000MB  10.5MB/s   06:22
xaa                                                                                        100% 4000MB   9.9MB/s   06:46
xab                                                                                         39% 1573MB   9.9MB/s   04:05 ETARead from remote host crete.ex.nii.ac.jp: Connection reset by peer
xab                                                                                        100% 4000MB   9.6MB/s   06:57

Important Links

Handling Binary data with Axis2 (MTOM/SwA): http://ws.apache.org/axis2/1_1/mtom-guide.html

Axis User’s Guide: http://ws.apache.org/axis/java/user-guide.html

The Semantic Web In Breadth: http://logicerror.com/semanticWeb-long

Understanding Axis2 Deployment Architecture: http://www.developer.com/open/article.php/3557741

Content Delivery and Distribution Services: http://www.web-caching.com/cdns.html

OWL Tutorial: http://www.cs.bell-labs.com/cm/cs/who/pfps/talks/owl-tutorial/

RDF Tutorial: http://www.w3schools.com/rdf/

RDF Validator: http://www.w3.org/RDF/Validator/

How to Blacklist a module…

fawad@Ubuntu-01:/etc/hotplug$ echo ‘blacklist orinoco’ | sudo tee -a
/etc/modprobe.d/my_blacklist
blacklist orinoco
fawad@Ubuntu-01:/etc/hotplug$ echo ‘blacklist orinoco_cs’ | sudo tee
-a /etc/modprobe.d/my_blacklist
blacklist orinoco_cs

Where orinoco_cs & orinoco are the modules names.

The above tutorial will blacklist the kernel modules at the starup. But you modules might be loaded which anything is hotplugged into your computer.

For that i could not actually come-up with a solution but i think the way is to intsert modules names in the file:

root@Ubuntu-01:/etc/network# more /etc/hotplug/blacklist

How to load Kernel modules at boot time…

fawad@Ubuntu-01:~$ more /etc/modules
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with “#” are ignored.

lp
mousedev
psmouse

Linux Commands…

Web Page With All Linux Commands…

Command to find what all files are open: $lsof
Command to see what is done when a command is executed: $strace , e.g. $strace ls

Command to change the file system of a disk
$sudo mkfs.ext3 -cv -L usbdisk2 /dev/sdc1

dpkg – a medium-level package manager for Debian
————————————————

This is like an rpm for Red-hat linux.

Man Page: http://www.fifi.org/cgi-bin/man2html/usr/share/man/man8/dpkg.8.gz

To list packages related to the editor vi:
dpkg -l ‘*vi*’

To search the listing of packages yourself:
less /var/lib/dpkg/available

To remove an installed elvis package:
dpkg -r elvis

To install a package, you first need to find it in an archive or CDROM. The “available” file shows that the vim package is in section “editors”:
cd /cdrom/hamm/hamm/binary/editors dpkg -i vim_4.5-3.deb