pf » Unix Job processing

Unix Job processing

linuxmisc

I learned something new from my brother the other day about unix job processing. We had written a script to do some specific analysis of the logs for dealazon.com, and it would take about 30 seconds to a minute for the script to complete.

I had known for quite some time that you can run a script in the background by appending an & to the end of your command, for instance:

$> ./some_slow_script.pl &

I often run scripts that take a while, but forget to append the & so they run in the background. Well it turns out you can hit Ctrl+Z this will pause the process that is currently running, and give you a shell. Now you can type bg to send that process into the background. Now you can use the jobs command to see how its doing, or the fg command to send it back into the foreground.

So for example you might do something like this:

$> ./some_slow_script.pl
hits Ctrl+Z
[1]+  Stopped   ./some_slow_script.pl
$>
$> bg
[1]+ ./some_slow_script.pl &
$> jobs
[1]+  Running   ./some_slow_script.pl &
$> jobs
[1]+  Done   ./some_slow_script.pl


Related Entries
6 people found this page useful, what do you think?

Trackback Address: 502/B96D1B5C28FD0AEA9905A36741111DFF
On 11/29/2005 at 12:20:36 AM MST jehiah wrote:
1
You can also background multiple processes, and recover them individually

hits Ctrl+Z [1]+ Stopped ./some_slow_script.pl hits Ctrl+Z on another process [2]+ Stopped ./another_slow_script.pl

Now you can recover them individually $ fg 1 or $ fg 2

On 11/29/2005 at 4:29:17 AM MST Brandon Harper wrote:
2
You should also check into screen if you'd like to play with background processes some more and so forth:

http://linuxreviews.org/man/screen/

Basically you can use it to start processes in different virtual terminals and detach from them to new terminals or just logout altogether. I used to use screen way back when to run IRC bots... I could start one in a screen, detach from it, and logout of my shell and it would still be running.

Actually, IIRC, you can also start background processes which will still run after you logout by prepending a 'nohup' in front of them. ie: 'nohup ./script &'. However screen gives you the ability to reattach to the process if you need to interact with it, check it's progress, etc.

On 11/29/2005 at 9:40:03 AM MST Pete Freitag wrote:
3
Cool tips Jehiah and Brandon - Thanks!

On 11/29/2005 at 10:58:21 AM MST Yves wrote:
4
Nice...

Stuff like this can certainly come in handy.

On 03/29/2006 at 1:26:22 AM MST kishore wrote:
5
how do i redirect the "[1] xxxx" output to a file (command &) is not the solution, as I NEED the id in a file




  



Spell Checker by Foundeo





Subscribe to my RSS Feed: solosub RSS
Tags