atlas collaboration cern-rrb-2014-054

ATLAS COLLABORATION
CERN-RRB-2014-054
Addendum No. 15
to the
Memorandum of Understanding
for Collaboration in the Construction of the
ATLAS Detector
Upgrade of the Trigger and Data Acquisition System
17.03.2014
Page 1
ATLAS COLLABORATION
17.03.2014
CERN-RRB-2014-054
Page 2
ATLAS COLLABORATION
CERN-RRB-2014-054
Considering that:
The construction of the ATLAS Detector is governed by a Memorandum
of Understanding, along with its Amendments and Addenda, setting out
the responsibilities of the different participating Institutes and Funding
Agencies for the construction of the ATLAS Detector 1 (Construction
MoU);
Maintenance and Operation of the ATLAS Detector is governed by a
Memorandum of Understanding for Maintenance and Operation (M&O
MoU) 2;
In order to be able to take full advantage of planned luminosity
upgrades of the LHC, the ATLAS Collaboration has proposed an
Upgrade Program of the ATLAS Detector, consisting of a set of
modifications and replacements of existing Sub-Detectors as well as new
additions to the Detector;
As part of the Upgrade Program, the ATLAS Collaboration has proposed
an upgrade of the Trigger and Data Acquisition (TDAQ) System;
On the basis of a Letter of Intent 3 and Technical Design Report 4
submitted in December 2011 and September 2013 and a detailed review
of the scientific merits, the technological feasibility and estimates of the
resources needed, the LHC Committee (LHCC) has recommended
approval of the TDAQ Upgrade to the CERN Research Board;
Based on the recommendation by the LHCC, the Research Board has
recommended to the Director General of CERN to approve the TDAQ
Upgrade;
The Director General has accepted the Research Board recommendation
and approved the TDAQ Upgrade.
It is agreed as follows
Memorandum of Understanding for Collaboration in the Construction of the ATLAS
Detector (RRB-D 98-44 rev.)
2 Memorandum of Understanding for Maintenance and Operation of the ATLAS Detector
(CERN-RRB-2002-035)
3 ATLAS Letter of Intent, Phase-I Upgrades (CERN-LHCC-2011-012)
4 ATLAS TDAQ Upgrade Technical Design Report (CERN-LHCC-2013-018)
1
17.03.2014
Page 3
ATLAS COLLABORATION
CERN-RRB-2014-054
Article 1: Purpose
1.1
The purpose of this Addendum and its Annexes is to lay down the terms
of participation of the contributing Institutes and Funding Agencies in
the construction, installation and commissioning of the TDAQ System
Upgrade in conformity with the Construction MoU along with its
amendments and addenda.
1.2
All the Annexes are an integral part of this Addendum.
Article 2: Parties
2.1
The Parties to this Addendum shall be all the Institutes that are
contributing to the upgrade of the TDAQ System (the TDAQ Upgrade
Institutes) and their Funding Agencies (the TDAQ Upgrade Funding
Agencies), and CERN as the Host Laboratory. The current list of TDAQ
Upgrade Institutes is given in Annex 1 and the current list of TDAQ
Upgrade Funding Agencies and Contacts is given in Annex 2.
Article 3: Duration
3.1
This Addendum takes effect from the date of signature and shall remain
valid until the ATLAS Management declares the end of TDAQ System
Upgrade.
3.2
Any TDAQ Upgrade Institute may withdraw its support from the TDAQ
System Upgrade by giving not less than eighteen months notice in
writing. In this event, reasonable compensation to TDAQ System
Upgrade shall be negotiated through the ATLAS Management and
endorsed by the RRB.
3.3
Any Institute that joins the TDAQ Upgrade Institutes after the start of
the TDAQ System Upgrade shall accept the agreements in force and
shall be expected to make an appropriate contribution to the TDAQ
System Upgrade as shall be specified in a corresponding Addendum to
this Addendum. This shall be negotiated by the ATLAS Management
and endorsed by the RRB.
Article 4: The TDAQ System Upgrade
4.1
The TDAQ System Upgrade is defined in detail in the Letter of Intent
and in the Technical Design Report submitted to the LHCC. The TDAQ
System Upgrade consists of a number of sub-units as listed in Annex 3.
17.03.2014
Page 4
ATLAS COLLABORATION
CERN-RRB-2014-054
4.2
The current management structure of the TDAQ System Upgrade is
described in Annex 4, as well as persons currently holding management
positions.
4.3
The technical participation of the TDAQ Upgrade Institutes is given in
Annex 3.
4.4
The ATLAS Collaboration decides for each TDAQ System Upgrade cost
item whether the cost is to be borne at the common expense of the
ATLAS Collaboration or not. The TDAQ System Upgrade cost items are
thereby divided into two categories:
4.4.1.
Common Items, comprising those costs that the ATLAS
Collaboration has agreed to bear at its common expense;
4.4.2. Specific items that are the responsibility of the TDAQ Upgrade
Institutes or groups of TDAQ Upgrade Institutes.
4.5
Annex 5 shows the value of the deliverables by Funding Agency, to
which the TDAQ Upgrade Institutes and TDAQ Upgrade Funding
Agencies are committed and for which they have foreseen the
appropriate funding.
4.6
Annex 6 gives the required CORE spending profile.
17.03.2014
Page 5
ATLAS COLLABORATION
CERN-RRB-2014-054
ANNEXES
Annex 1:
List of TDAQ Upgrade Institutes and Contact Persons
Annex 2:
List of TDAQ Upgrade Funding Agencies and Contact Persons
Annex 3:
List of TDAQ Upgrade sub-units and deliverables to be
provided by the TDAQ Upgrade Institutes and Funding
Agencies
Annex 4:
TDAQ Upgrade Management Structure and Persons currently
holding management positions
Annex 5:
Value of Deliverables, grouped by Funding Agency, of the
TDAQ System Upgrade
Annex 6:
CORE Spending profile
17.03.2014
Page 6
ATLAS COLLABORATION
CERN-RRB-2014-054
The European Organization for Nuclear Research (CERN)
and
.................................................
declare that they agree on the Present Addendum to the Memorandum of
Understanding for Collaboration in the Construction of the ATLAS Detector
Done in Geneva
Done in .............................
............................................
............................................
for CERN
for ......................................
............................................
............................................
<CERN name>
<CERN title>
............................................
............................................
............................................
17.03.2014
Page 7
ATLAS COLLABORATION
17.03.2014
CERN-RRB-2014-054
Page 8
ATLAS COLLABORATION
CERN-RRB-2014-054
Annex 1: List of TDAQ Upgrade Institutes and Contact
Persons
Institute
Argonne National Laboratory, USA
Contact Person
Robert Blair
University of Arizona, USA
Ken Johns
University of Birmingham, United Kingdom
Alan Watson
Brookhaven National Laboratory (Brookhaven BNL), USA
Srini Rajagopalan
National Institute of Physics and Nuclear Engineering (IFIN-HH),
Bucharest (Bucharest IFIN-HH) , Romania
Mihai Caprini
Cavendish Laboratory, University of Cambridge, UK
Mark Andrew
Thomson
Nick Ellis
European Laboratory for Particle Physics, CERN, Switzerland
Niels Bohr Institute (Copenhagen NBI), University of Copenhagen,
Denmark
AGH University of Science and Technology and Jagiellonian University
(Cracow AGH/UJ ), and Institute of Nuclear Physics Polish Academy
of Sciences (Cracow IFJ PAN), Poland
Harvard University, Department of Physics, USA
Stefania Xella
Kirchhoff-Institut fur Physik, Heidelberg (Heidelberg KIP), Germany
Hans-Christian
Schultz-Coulon
KEK, High Energy Accelerator Research Organization, Japan
Osamu Sasaki
Kobe University, Japan
Hisaya Kurashige
Kyoto University, Department of Physics, Japan
Masaya Ishino
Universidad Nacional de La Plata (UNLP), Argentina
Maria Teresa Dova
Institut fuer Physik, Universitaet Mainz, Germany
Volker Büscher
Michigan State University (Michigan SU), Department of Physics and
Astronomy, USA
Jim Linnemann
M.V.Lomonosov Moscow State University (Moscow SU), Russia
Serguei Sivoklokov
Graduate School of Science and Kobayashi-Maskawa Institute,
Nagoya University, Japan
Makoto Tomoto
INFN Napoli and Universita' di Napoli, Dipartimento di Fisica, Napoli,
Italy
Vincenzo Izzo
FOM - Institute SAF Nikhef and University of Amsterdam/Nikhef,
Netherlands
Joseph Vermeulen
University of Oregon, USA
Eric Torrence
Laboratório de Instrumentação e Física Experimental de Partículas
(LIP), Portugal (Portugal 1-LIP)
Patricia Conde
Muíño
Rutherford Appleton Laboratory (RAL), UK
Robin Middleton
17.03.2014
Tomasz Bold
John Huth
Page 9
ATLAS COLLABORATION
CERN-RRB-2014-054
Universidade Federal do Rio De Janeiro UF, COPPE/EE/I, Brazil
Jose Seixas
INFN Roma and Sapienza Universita' di Roma (Roma I), Dipartimento
di Fisica, Italy
Riccardo Vari
INFN Roma Tor Vergata and Universita' di Roma Tor Vergata (Roma
II), Dipartimento di Fisica, Italy
Rinaldo Santonico
Stockholm University, Sweden
Sten Hellman
International Center for Elementary Particle Physics and Department
of Physics, The University of Tokyo (Tokyo ICEPP), Japan
Hiroshi Sakamoto
Universidad Antonio Narino, Centro de Investigaciones, Bogota (UAN
Bogota), Colombia
The Weizmann Institute of Science, Israel
Marta Losada
17.03.2014
Lorne Levinson
Page 10
ATLAS COLLABORATION
CERN-RRB-2014-054
Annex 2: List of TDAQ Upgrade Funding Agencies and
Contacts
Funding Agency
Country
National Contact
Physicist
Argentina
Brazil
Argentina
Brazil
Maria-Teresa Dova
Fernando Marroquim
Colciencias
CERN
Denmark
Colombia
Switzerland
Denmark
Marta Losada
Giuseppe Mornacchi
Jorn Dines Hansen
Germany BMBF
INFN
Germany
Karl Jakobs
Italy
Anna Di Ciaccio
Israel
Japan
Israel
Japan
Giora Mikenberg
Katsuo Tokushuku,
Tomio Kobayashi
Netherlands
Poland
Netherlands
Poland
Paul de Jong
Barbara Wosiek
Portugal
Romania
Portugal
Romania
Amelia Maio
Calin Alexa
Russia
Sweden
United Kingdom
Russia
Sweden
United
Kingdom
USA
Alexander Zaitsev
Bengt Lund-Jensen
Stephen Lloyd
USA
17.03.2014
Srinivasan Rajagopalan,
Jim Cochran
Institutes
La Plata
Rio de Janeiro
UF
UAN Bogota
CERN
Copenhagen
NBI
Heidelberg KIP,
Mainz
Napoli, Roma I,
Roma II
Weizmann
KEK, Kobe,
Kyoto, Nagoya,
Tokyo ICEPP
Nikhef
Cracow
AGH/UJ,
Cracow IFJ PAN
Portugal 1-LIP
Bucharest IFINHH
Moscow SU
Stockholm
Birmingham,
Cambridge, RAL
Argonne,
Arizona,
Brookhaven
BNL, Harvard,
Michigan SU,
Oregon
Page 11
ATLAS COLLABORATION
CERN-RRB-2014-054
Annex 3: List of TDAQ Upgrade Sub-Units
1.0
1.1
Central Trigger
Central Trigger Processor
1.2
Level-1 Topology processor
1.3
MuCTPi
2.0
2.1
2.2
2.4
2.5
Level-1 Calorimeter Trigger
eFEX system
jFEX system
Hub, ROD and Optical Plant(HRO)
Tile Input
2.6
2.7
3.0
3.1
3.2
3.3
3.4
4.0
4.1
PreProcessor nMCM
Extended Merger Module (CMX)
Level-1 Muon Trigger
End-cap Sector Logic
Tile D-layer Muon Interface
NSW Trigger Processor
Barrel MUCTPI Interface
DAQ/HLT
Dataflow
17.03.2014
New CTP-CORE and CTP-OUT modules
for the Central Trigger Processor
Level-1 Topological Trigger and
MuCTPI-Topo modules
New MuCTPI to interface the upgraded
Muon Trigger to the Central Trigger
Processor
eFEX and jFEX systems, including Hub and
ROD modules and Optical Plant
PreProcessor LCD and JEM daughter
boards (Tile input)
Preprocessor new Multi-Chip Modules
Extended Merger (CMX) modules
Barrel EndCap Sector Logic modules
D-Layer Muon interface modules
Muon New Small Wheel Trigger processor
Barrel Sector Logic - MuCTPI interface
FELIX readout system and associated
networking; Updated SFO hardware
platform
Page 12
ATLAS COLLABORATION
CERN-RRB-2014-054
MoU Item 1.0 Central Trigger
Description: Design and construction of new CTP-CORE and CTP-OUT
modules for the Central Trigger Processor, L1Topo modules for the
Topological Trigger, and new MuCTPI and MuCTPI-Topo modules to
interface the upgraded Muon Trigger to the Central trigger processor, with
associated firmware.
Total Cost
1.1
1.2
1.3
kCHF
90.0
424.3
342.0
856.3
CTP-CORE and CTP-OUT modules
L1Topo and MuCTPI-Topo Modules
MUCTPI modules
Work Responsibility
CERN
Copenhagen NBI
Cracow
Mainz
Nikhef
Design and production of CTP-CORE and MuCTPI modules
Design and production of CTP-OUT modules
L1Topo ROD firmware
Design and production of L1Topology system
Design and production of MUCTPI-Topo module
Cost Sharing
CERN (Switzerland)
Copenhagen (Denmark)
Mainz (Germany BMBF)
Nikhef(Netherlands)
Total
17.03.2014
CTP Modules
67%
33%
100%
L1Topo
82%
18%
100%
MuCTPi
100%
100%
Total
47%
4%
41%
9%
100%
Page 13
ATLAS COLLABORATION
CERN-RRB-2014-054
MoU Item 2.0 Level-1 Calorimeter Trigger
Description: Design and construction of eFEX and jFEX systems, including
Hub and ROD modules and Optical Plant; Design and construction of
PreProcessor LCD and JEM daughter boards (Tile input) ; Design and
construction of Preprocessor nMCMs; and Design and construction of
Extended Merger (CMX) modules, all with associated firmware.
Total Cost
2.1
2.2
2.4
2.5
2.6
2.7
kCHF
1,390.6
637.0
700.5
122.5
500.0
153.6
3,504.2
eFEX system
jFEX system
Hub, ROD and Optical Plant (HRO)
Tile Input
PreProcessor nMCM
Extended Merger Module (CMX)
Work Responsibility
Birmingham
Cambridge
Cracow
Heidelberg KIP
Mainz
Michigan SU
Oregon
RAL
Stockholm
Combined eFEX/jFEX test module; eFEX (algorithmic) firmware
ROD mezzanine; eFEX ROD firmware
jFEX ROD firmware
nMCM hardware and firmware; Preprocessor LCD
Daughterboard and firmware
JEM Daughterboard and firmware ; jFEX system hardware and
firmware
CMX hardware and Firmware ; Common eFEX/jFEX Hub
module; Optical Plant
FEX algorithm firmware
eFEX hardware, eFEX infrastructure Firmware; DCS Firmware
Tile Input firmware; JEM Daughterboard and firmware
Cost Sharing
eFEX
Heidelberg KIP, Mainz (BMBF)
Copenhagen NBI (Denmark)
Cracow(Poland)
Birmingham, Cambridge,
RAL (UK)
Stockholm (Sweden)
Michigan SU, Oregon (USA)
Total
17.03.2014
jFEX
100%
100%
HRO Tile-in
59%
16%
14%
17%
nMCM
100%
CMX
41%
100%
100%
53%
100%
100%
100%
100%
100%
Page 14
Total
35%
3%
3%
43%
1%
15%
100%
ATLAS COLLABORATION
CERN-RRB-2014-054
MoU Item 3.0 Level-1 Muon Trigger
Description: Design and construction of End-cap Sector Logic modules, Tile
D-Layer Muon interface modules, the Muon New Small Wheel Trigger
processor, and the Barrel Sector Logic - MuCTPI interface, with associated
firmware.
Total Cost
3.1
3.2
3.3
3.4
kCHF
500.0
264.8
679.7
72.8
1,517.3
End-cap Sector Logic
Tile D-layer Muon Interface
NSW Trigger Processor
Barrel Sector Logic - MuCTPI interface
Work Responsibility
Arizona
Brookhaven BNL
Bucharest
CERN
Harvard
KEK
Kobe
Kyoto
Nagoya
Napoli
Portugal LIP
Rio de Janeiro UF
Roma I
Roma II
Saclay
Tokyo ICEPP
UC Irvine
Weizmann
17.03.2014
NSW Trigger processor hardware
NSW Trigger processor hardware
NSW Trigger processor hardware
Tile D-Layer infrastructure
Micromegas Trigger processor firmware
Sector logic and Tile D-Layer interface Hardware design and
construction
Sector logic hardware design and trigger firmware; Tile D-layer
firmware
Sector logic Firmware; Tile D-layer interface hardware and
firmware
Sector logic hardware design and trigger firmware
Barrel MuCTPi board optical link and interface with the
RODbus
Tile D-Layer hardware & firmware design and construction
Tile D-layer hardware & firmware design and construction
Barrel MuCTPI Board layout and firmware
Barrel MuCTPI Board interface with Sector Logic
Micromegas Trigger processor firmware
Endcap Sector Logic hardware design and readout firmware;
NSW Trigger processor firmware
NSW Trigger Processor
sTGC Trigger processor firmware
Page 15
ATLAS COLLABORATION
CERN-RRB-2014-054
Cost Sharing
Rio de Janeiro UF (Brazil)
CERN
Copenhagen NBI (Denmark)
Weizmann (Israel)
Napoli, Roma I, Roma II
(Italy)
KEK, Kobe, Kyoto, Nagoya,
Tokyo ICEPP (Japan)
Sector
Logic
100%
Tile-D
30%
11%
9%
17.03.2014
11%
100%
45%
BarrelMuCTPi
51%
38%
Nikhef (Netherlands)
Bucharest (Romania)
Portugal LIP (Portugal)
Arizona, Brookhaven BNL,
Harvard (USA)
Total
NSW
Trig
100%
Total
5%
2%
2%
20%
2%
40%
15%
49%
2%
7%
2%
18%
100%
100%
40%
100%
Page 16
ATLAS COLLABORATION
CERN-RRB-2014-054
MoU Item 4.0 DAQ and High-Level trigger
Description: Development of FELIX readout system and associated
networking; Selection of SFO hardware platform.
Total Cost
4.1
kCHF
1,263.5
1,263.5
Dataflow
Work Responsibility
CERN
Nikhef
Weizmann
Argonne,
Brookhaven BNL
SFO server Design, Design and production of FELIX
hardware
Design and Production of FELIX hardware and firmware
Design and Production of FELIX hardware and firmware
Design and Production of FELIX firmware
Cost Sharing
La Plata (Argentina)
Bogota (Colombia)
CERN
Weizmann (Israel)
Nikhef (Netherlands)
Moscow SU(Russia)
UK
Total
17.03.2014
Dataflow
4%
8%
26%
8%
35%
8%
12%
100%
Total
4%
8%
26%
8%
35%
8%
12%
100%
Page 17
ATLAS COLLABORATION
CERN-RRB-2014-054
Annex 4 : TDAQ Organisation and Management
Structure
The TDAQ Organization operates under the control and guidance of the
ATLAS Collaboration Management Structure as defined in Annex 5 of the
ATLAS Construction MoU[2]. The current TDAQ Management Structure
organization chart is shown in Figure 1.
ATLAS Upgrade
Steering Committee
ATLAS
Executive Board
Trigger DAQ Project Leader
Trigger & DAQ Institute Board
Level-1 Calorimeter management
FTK Institute Board
Level-1 upgrade
coordinator
Software coordinator
Fast Tracker (FTK)
coordinator
Other representation
System run
coordinator(s)
Central Trigger
DAQ/HLT
coordination
(inc. FELIX)
Level-1
coordination
Trigger
CTP
Level-1 Muon
Level-1 Calorimeter
eFEX
jFEX
CMX
MUCTPI
Endcap
NSW trigger
processors
Barrel
Tile D-layer
nMCM
Topology
Figure 1: Current TDAQ Organisation
TDAQ is led by a TDAQ Management Team (TDMT) of two members with
complementary roles, each member being elected by the Trigger and DAQ
Institute Board (TDIB) according to ATLAS rules and serving a two year term.
The terms of office are arranged in antiphase, the TDMT member in their
second year of office acting as the TDAQ Project Leader. The TDAQ Project
Leader is a member of the Executive Board and directly responsible to the
ATLAS Executive Board and Upgrade Steering Committee for all aspects of
the TDAQ upgrade.
The major construction work in the TDAQ upgrade is related to the Level-1
Trigger, and falls under the responsibility of the Level-1 Upgrade
Coordinator. This person reports to the ATLAS Upgrade Steering Committee
together with the TDAQ Project Leader, and also reports to the TDMT and the
TDAQ Steering Group.
Overall coordination of the work for the TDAQ upgrade is provided by the
TDAQ Steering Group, whose structure may evolve after the LS1 work is
completed. The members are coordinators of the major TDAQ activities. The
17.03.2014
Page 18
ATLAS COLLABORATION
CERN-RRB-2014-054
composition is proposed by the TDMT and endorsed by the TDAQ Institute
Board.
The current members include system run coordinators, coordinators of Level1 Calorimeter Trigger, Level-1 Central Trigger, Level-1 Muon Endcap and
Barrel Trigger, DAQ/HLT, TDAQ Software Coordination, Level-1 Track
Trigger, Fast Track Processor (FTK), Physics (representative in Upgrade
Physics Steering Group), Upgrade Simulation, Upgrade Detector Readout,
and ATLAS Trigger coordination.
Institutes participating in the upgrade by providing financial resources or
staff attend the TDIB on an equal basis with institutes participating in
operation of the running TDAQ system. The TDIB takes decisions on major
technical issues and on sharing of resources and responsibilities, following
recommendations from the TDAQ Steering Group and TDAQ Management.
Persons holding TDAQ Upgrade-related Management Positions
Position
TDMT and current PL
TDMT
Level-1 Upgrade Coordinator
TDIB Chair
Name
D. Francis
D. Strom
S. Veneziano
N. Gee
Institute
CERN
Oregon
Rome I
RAL
Level-1Calorimeter Trigger
coordination
Level-1 Muon Trigger coordination
R. Stamen
B. Barnett
R. Vari
O. Sasaki
T. Pauly
Heidelberg KIP
RAL
Rome I
KEK
CERN
R. Hauser
F. Winklmeier
MSU
Oregon
Central Trigger Processor
coordination
DAQ/HLT Software Coordinator
Trigger Software Coordinator
17.03.2014
Page 19
ATLAS COLLABORATION
CERN-RRB-2014-054
Annex 5: Deliverables to be provided by TDAQ Upgrade Funding Agencies (CORE cost, kCHF)
1.0 Central Trigger
Funding Agency
Argentina
Brazil
CERN
Colombia
Denmark
Germany BMBF
Israel
Italy INFN
Japan
Netherlands
Poland
Portugal
Romania
Russia
Sweden
UK
USA
Total
17.03.2014
CTP
L1Topo
60
2.0 Level-1 Calorimeter Trigger
MuCTPi
eFEX
jFEX
HRO Tile-in
nMCM
CMX
80
30
342
30
115
346
637
25
72
500
306
500
100
78
100
30
102
50
1391
90
424
342
1391
637
118
368
701
122
500
154
154
4.0
DAQ/HLT
Data
Total
flow
50
50
80
325
757
100
100
170
1556
97
403
37
37
600
36
436
550
100
30
102
100
100
50
155 1664
793
73
1263 7142
3.0 Level-1 Muon Trigger
NSW
Barrel
Sector
Tile-D
Trig
MuCTPi
Logic
500
265
272
680
Page 20
ATLAS COLLABORATION
CERN-RRB-2014-054
Annex 6: CORE Spending Profile
17.03.2014
Page 21