The STAR server mirror has had many lives, more details below for information on the current server and on older incarnations.
Starbase is a small server at the University of Chicago. It's at starbase.uchicago.edu but requires you to be inside the UChicago network to access it.
To log into starbase use ssh your_user_name@starbase.uchicago.edu
To run the pipeline:
darepype is installed on starbase so available in python
SEO pipeline is on starbase under /data/scripts/pipeline
To run data make a copy of the piperun.txt from the /data/Temp/Users/berthoud/testrun folder. Then change it so it finds your files. Then run it. See Marc's talk on pipeline to see how to run piperun.txt files can be run with darepype.py
To access data:
The SEO Archive drive is mounted under /data/Archive, it is read only
The SEO Temp drive is mounted under /data/Temp, it is read-write
A set of master FLAT DARK and PFIT files is under /data/Archive/StoneEdge0.5m/2022/Masters-15C
We are currently (2018) setting up a new Starsbase server. In the meantime, please go directly to the stars server to download files.
Starsbase was originally a Raspberry Pi project set up to act as a local mirror for stars.uchicago.edu. It ran on Arch Linux ARM, a variant of Arch Linux for ARM designed processors.
As of 1/1/2020, the computer running StarsBase has been turned into a server for the LENS project. The 2TB external drive still contains the two data partitions with all of the existing data if one wishes to create a new StarsBase.
The 2018 starsbase is running Ubuntu Server. The machine is a 64bit PC with 2GB of memory, AMD Athlon X2 Dual Core 2.0GHz. The computer is from about 2010.
These are the things we would like to have on the server, most important at the top.
Accounts and Drives: A guest/student account with very limited permissions. User accounts for all relevant users. HDD space with at least 100GB for /home. Another drive under /data to share over SAMBA and online.
Sharing: A public (maybe /data/public) drive shared over SAMBA for anyone in the 128.135.40.* address space. This should be accessible from Windows, Mac and Linux machines.
A webserver which allows people to access the /data/public shared drive (and maybe other services)
Set privileges for different accounts / make guest account. Make user group for all the users. Ubuntu Help Page: https://help.ubuntu.com/lts/serverguide/user-management.html
Samba Server: Set up and publish details
Fix the IP address to only have one IPV4 address on interface enp0s10.
Accounts: yerkesstudent, alex (Alex Scerba), adamh (Adam Huber), berthoud (Marc Berthoud)
Drives:
sda1: Bootable 232GB (Main OS Drive)
sdb1: External 1.4TB (EMPTY Drive)
sdb2: External 465GB (LOCAL Drive)
IP Addresses: DHCP and 128.135.40.94
Samba: Config is under /etc/samba/smb.conf
Link to guide used for setup: https://help.ubuntu.com/lts/serverguide/samba-fileserver.html
List of system administration and bugfixes on this machine.
2018-Jan: Who did whaaaaaaaaaaaaaaaat? Please!!!!!!!!!!!!!!!!!!! add log info here. (Marc)
2018-Jan: Installed Ubuntu Server 17.10 (not LTS) (Alex Scerba)
2018-Feb: Made myself an account and installed emacs (Marc)
2018-Feb: Made account 'alex,' set up samba server, set myself as admin, set YerkesStudent as basic user and added only to group students:x:10000, added all existing users to group students:x:10000, set static IP to 128.135.40.94, set accounts 'alex,' 'berthoud,' 'adamh' to administrative groups (Alex Scerba)
2018-Feb: Made account 'adam' (Adam)
2018-March: 2 IPs (one DHCP and one 128.135.40.94), External drive partitions called LOCAL (465GB) and EMPTY (1.4TB), LOCAL and EMPTY given read and write permissions for all users.
Sources
Sources used to set up the 2018 Ubuntu StarsBase
The details below are for the "old" starsbase which was set up in 2013 on a Rasberry Pi.
Problem: All folders above the shared one need to have R-X access for all.
(1) Raspberry Pi
(1) 2 TB Hard Drive (can be more or less)
(1) SD Card
Internet connection
http://archlinuxarm.org/platforms/armv6/raspberry-pi - Follow the installation instructions. NOTE: When you log in as root, CHANGE THE PASSWORD. The password only works once, so be sure to run passwd above all else.
See the pacman.conf file to find the section to change in order to download packages via the pacman package manager.
See the fstab file below for a configuration to automatically mount the hard drive on boot. If it doesn't work, make sure the file paths mentioned in the fstab exist.
See the smb.conf file below to get an idea on how I've set the server up.
See the ethernet-eth0 file, which would be located under /etc/network.d, to see how I loaded a static IP address. If this doesn't work, or doesn't exist, follow https://wiki.archlinux.org/index.php/Beginners'_Guide#Static_IP, as it stays updated.
For partitioning your hard drive, use your partition manager. I allocated 25% of the space to a local partition and 75% to the mirror.
As well, both partitions are fat32 filesystems.
Instructions on how to get to your partitioner are below:
For Windows: http://windows.microsoft.com/en-us/windows-vista/create-and-format-a-hard-disk-partition
For Mac: http://support.apple.com/kb/PH5845
For Unix based Distributions: http://gparted.sourceforge.net/display-doc.php?name=help-manual (be sure to download gparted.)
(If you don't like gparted, format it with your favorite partition manager.)
Follow the link from the first website. Login is root and password is root.
Run passwd. If you don't, you're going to regret it because you won't be able to log back in if you log out. Change the password to whatever you want.
Add a user. Whatever user it is, make sure you know its UID (user ID) and GID (primary group ID) which you can find with id username, where username is the user you just made.
Make sure you edit this in your smb.conf, if applicable.
Edit the pacman.conf file in the aforementioned section. You'll be changing the SigLevel from whatever it is to TrustAll.
Update the system by running pacman -Syyu. If this doesn't work, check https://www.archlinux.org/news/ for anything you may have to do to update.
Once you're updated, run pacman -S openssh samba.
You'll ensure that you're installing SSH this way. Ensure that it's enabled in the unit files by running systemctl enable sshd.
You should be able to ssh into your Pi now. It'll be better when you change your IP to be fixed, so just wait a few more steps.
To enable Samba, follow https://wiki.archlinux.org/index.php/Samba.
Go to the /etc directory and edit the fstab, the samba/smb.conf and the network.d/ethernet-eth0 files as seen below.
Ensure that all the locations mentioned in the fstab and samba/smb.conf exist, otherwise it won't work.
Check the UID and the GID in the fstab to make sure they align with the user you created
Also, make sure everything is spelled correctly.
If all else fails, check https://wiki.archlinux.org/index.php/ for your problem.
Another note, change the IP address found in the network.d/ethernet-eth0 file if someone tells you to change the IP.
Reboot.
To set up the mirroring script, ssh into your stars.uchicago.edu account.
In the /data/scripts folder, you'll find the rsync script.
Set crontab up so that you can add it for at least once a day.
You'll need to set up your ssh profile to ssh into the Pi without a password. Run the following command from stars.uchicago.edu:
ssh-keygen -t rsa -C "username@set-ip" # Make sure to set username to the user you created, and set-ip to the IP you assigned the Pi.
Just leave everything blank, even the password prompts. This ensures that you can log into your Pi without a password.
Et voila, you've just set up a Samba server in (about) 10 steps!
Specific Notes:
IP Address: 128.135.40.94
Name of Server: STARSBASE
Folders:
local (file server, readable, writable)
stars (mirror, readable, non-writable)
Full URI's (in case you're lazy):
smb://128.135.40.94/local
smb://128.135.40.94/stars
Open up File Explorer.
In index bar type following: \\128.135.40.94\LocalShare
Done
Method B (If Windows is being Windows)
Download and install Cyberduck
Click "Open Connection"
Select the drop-down menu and select "SFTP (SSH File Transfer Protocol)"
In the "Server" box enter "128.135.40.94"
Enter the login name and password that you use on the server
Click "Connect"
Click "Yes" on the dialogue box.
Once in, navigate to /mnt/LOCAL/
Done
Tip: Make a shortcut on your desktop to \\128.135.40.94\LocalShare
Open Finder.
Go to Go -> Connect to Server
Type in smb:// <IP-address> / <folder> where <IP-address> is the IP the server was assigned and <folder> is either the local or the mirror folder.
Alternatively, you can type in the name of the server in lieu of the <IP-address.>
Enter as a guest.
Instructions for popular file browsers are found below: Note: You may have to install something called gvfs. Search for it with your package manager.
Nautilus (GNOME Desktop): http://www.centos.org/docs/5/html/Deployment_Guide-en-US/s1-samba-connect-share.html
Dolphin (KDE Desktop): https://wiki.archlinux.org/index.php/KDE#Samba.2FWindows_support
Thunar (XFCE Desktop): https://wiki.archlinux.org/index.php/Thunar#Using_Thunar_to_browse_remote_locations
PCManFM (LXDE Desktop): https://wiki.archlinux.org/index.php/PCManFM#Trash_support.2C_browsing_network_shares.2C_and_automounting_with_gvfs
Type in smb:// <IP-address> / <folder> where <IP-address> is the IP the server was assigned and <folder> is either the local or the mirror folder.
Alternatively, you can type in the name of the server in lieu of the <IP-address.>
Enter as a guest.