Data Library Software Tools

Statistical Software

Tool name

Source

requirements

What it does

Use it for

SAS

http://www.sas.com/

Unix, windows, mac

Statistical data management and analysis

Analyzing, verifying, managing data.

SPSS

http://www.spss.com/

Unix, windows, mac

Statistical data management and analysis

Analyzing, verifying, managing data.

 

Tools for converting files

Tool name

Source

requirements

What it does

Use it for

Data Junction

http://www.datajunction.com/

Windows, some Unix

Transfers data between statistical software, database, spreadsheets and more.

Converting data in statistical software format to other formats.

DBMS/COPY

http://www.conceptual.com/index.htm

Windows, unix

Transfers data between statistical software, database, spreadsheets and more.

Converting data in statistical software format to other formats

 

Stat/Transfer

 

http://www.stattransfer.com/

Windows, unix

Transfers data between statistical software, database, spreadsheets and more.

Converting data in statistical software format to other formats

U2x

http://www.nmt.edu/~mandrake/
http://www.nmt.edu/~mandrake/programs.html

windows

Converts unix text files to windows text files

Making Unix text files work in Windows

dmap

quincy.lib.Virginia.EDU/iassist/

perl

Converts datamaps for Card-Image data files into spss

Creating SPSS job cards from ICPSR datamap files.

DUEL-1

quincy.lib.Virginia.EDU/iassist/

perl

Converts Dualab formatted 1970 Census Count 4 data

Makes 1970 US census data usable

Fix_codebook

quincy.lib.Virginia.EDU/iassist/

perl

Removes unnecessary line-printer formatting and non-ASCII characters from plain text files.

Clean up ICPSR Machine-Readable Codebooks

O2a

quincy.lib.Virginia.EDU/iassist/

perl

converts ebcdic/binary osiris dictionaries to ascii

Make osiris dictionaries usable without having osisris software

SpiresFilter

quincy.lib.Virginia.EDU/iassist/

perl

Converts SPIRES records for ICPSR studies into an SGML catalog and creates individual HTML Files.

(SPIRES is a database software. ICPSR used to distribute its catalog in SPIRES format.)

 

Tools for compressing and uncompressing files
and for bundling several files together

Tool name

Source

requirements

What it does

Use it for

Compress

Comes with OS

Unix

Compresses and uncompress files

With .Z extension

Uncompressing files from ICPSR

Gzip, Gunzip

http://www.gnu.org/

unix

Uncompresses files compressed with Gzip with .gz extention

Compress and Uncompress files

Zip

http://www.pkware.com/

Windows, dos, unix, os/2

Uncompresses zipped and pkzipped files

Compress and Uncompress files

Zip, pkzip

.zip: pkzip 2. (LZ77 with hashing, plus secondary static Huffman coding on a block basis). Contact: support@pkware.com

or http://www.pkware.com/

ftp://ftp.simtel.net/pub/simtelnet/msdos/zip/pkz204g.exe

ftp://garbo.uwasa.fi/pc/arcers/pkz204g.exe

ftp://ftp.simtel.net/pub/simtelnet/win95/compress/pk250w32.exe (WIN95)

 

dos

Uncompresses zipped and pkzipped files

Compress and Uncompress files

Zip

zip 1.1.. (compatible with pkzip 1.10.)

For corresponding unzip, see unzip 5.32 below).

ftp://ftp.cdrom.com/pub/infozip/src/zip11.zip

 

Unix dos, vms, os/2

Uncompresses zipped and pkzipped files

Compress and Uncompress files

Zip 2.2 and unxip 5.3.2

zip 2.2 and unzip 5.32 Compatible with pkzip 2.04g (LZ77 with hashing, plus secondary static Huffman coding on a block basis). Contact: zip-bugs@lists.wku.edu See also http://infozip.cdrom.com/pub/infozip/

(On SGI, do not confuse with the editor also named 'zip'.) ftp://ftp.cdrom.com/pub/infozip/src/zip22.zip(source) ftp://ftp.cdrom.com/pub/infozip/src/unzip532.*(source) ftp://ftp.cdrom.com/pub/infozip/MSDOS/zip22x.zip (MSDOS exe)

Unix, dos, vms, os/2, amiga

Uncompresses zipped and pkzipped files

Compress Uncompress files

Stuffit

www.aladdinsys.com/

MacOS

Uncompresses and un-tars many different compression formats

Uncompress and un-archive files from almost any source onto a Macintosh

winzip

www.winzip.com/

windows

Compresses and uncompresses many formats

Uncompress files from almost anywhere onto a Windows machine

Tar

Comes with OS

Unix

"tape archive" combines many files into one to create a "tar" file. Reads and unbundles "tar" files

Get multiple files with a single ftp command. Un-bundle "tar" files.

For additional compression software and notes on file extensions and much more see the Compression FAQ, particularly
http://www.faqs.org/faqs/compression-faq/part1/section-2.html, "What is this .xxx file type? Where can I find the corresponding compression program?

Tools for viewing and examining files

Tool name

Source

requirements

What it does

Use it for

Acrobat

www.adobe.com

 

Displays PDF files

Display documentation

Head

Comes with OS

Unix

Look at the first few lines of a file

View data and documentation files

Tail

Comes with OS

Unix

Displays the last several lines of a file

View data and documentation files

Less

Comes with OS

Unix

Displays files one screen at a time

View and examine data and documentation files.

List

http://www.buerg.com/main.html

Dos

Displays files in ASCII or HEX

View and examine data and documentation files.

Textbrowser

http://www.home.gil.com.au/~jlamb/

macOS

Opens any file and displays it in text or Hex.

View and examine data and documentation files.

V

www.fileviewer.com

Windows

View files

View and examine data and documentation files.

Vedit

http://www.vedit.com/

Windows, SCO unix, xenix, linux

Edit files of unlimited size and line length, in ASCII or ebcdic

View, examine, and edit data and documentation files.

Cio

quincy.lib.Virginia.EDU/iassist/

perl

Checks out plain ASCII text files

Examine data files

Maxline

quincy.lib.Virginia.EDU/iassist/

C compiler, unix, dos

Look at line lengths and count 'odd' characters. Useful for a first quick (jaundiced?) look at an imported file.

Examine data files.

Wc

Comes with OS

Unix

Counts words, characters, and lines in a file

Examine data and documentation files.

File

Comes with OS

Unix

Determines types of some common files.

Tell difference between text files and non-text files.

hexdump

Comes with OS

unix

displays a file in hexadecimal, octal, decimal, and ascii

Examine data files

od, xd

Comes with OS

Unix

displays a file in octal and hexadecimal

Examine data files

 

Back to LIS 839 Syllabus