e-learning
Running Jobs on Remote Resources with Pulsar
Abstract
Pulsar is the Galaxy Project's remote job running system. It was written by John Chilton (@jmchilton) of the Galaxy Project. It is a python server application that can accept jobs from a Galaxy server, submit them to a local resource and then send the results back to the originating Galaxy server.
About This Material
This is a Hands-on Tutorial from the GTN which is usable either for individual self-study, or as a teaching material in a classroom.
Questions this will address
- How does pulsar work?
- How can I deploy it?
Learning Objectives
- Have an understanding of what Pulsar is and how it works
- Install and configure a RabbitMQ message queueing server
- Install and configure a Pulsar server on a remote linux machine
- Be able to get Galaxy to send jobs to a remote Pulsar server
Licence: Creative Commons Attribution 4.0 International
Keywords: Galaxy Server administration, ansible, git-gat, jobs
Target audience: Galaxy Administrators
Resource type: e-learning
Version: 48
Status: Active
Prerequisites:
- A server/VM on which to deploy Pulsar
- Ansible
- Connecting Galaxy to a compute cluster
- Galaxy Installation with Ansible
- Mapping Jobs to Destinations using TPV
- Reference Data with CVMFS
Learning objectives:
- Have an understanding of what Pulsar is and how it works
- Install and configure a RabbitMQ message queueing server
- Install and configure a Pulsar server on a remote linux machine
- Be able to get Galaxy to send jobs to a remote Pulsar server
Date modified: 2024-06-14
Date published: 2019-01-28
Contributors: Björn Grüning, Bérénice Batut, Catherine Bromhead, Enis Afgan, Gianmauro Cuccuru, Helena Rasche, Lucille Delisle, Marius van den Beek, Martin Čech, Mira Kuntz, Nate Coraor, Nicola Soranzo, Nuwan Goonasekera, Saskia Hiltemann, Simon Gladman
Activity log
