-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathautodiff_8cpp_source.html
More file actions
367 lines (365 loc) · 58 KB
/
autodiff_8cpp_source.html
File metadata and controls
367 lines (365 loc) · 58 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
<!-- HTML header for doxygen 1.9.3-->
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "https://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/xhtml;charset=UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=11"/>
<meta name="generator" content="Doxygen 1.16.1"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<title>MimIR: src/mim/plug/autodiff/autodiff.cpp Source File</title>
<link href="tabs.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="jquery.js"></script>
<script type="text/javascript" src="dynsections.js"></script>
<script type="text/javascript" src="doxygen-awesome-darkmode-toggle.js"></script>
<script type="text/javascript" src="doxygen-awesome-fragment-copy-button.js"></script>
<script type="text/javascript" src="doxygen-awesome-interactive-toc.js"></script>
<script type="text/javascript" src="doxygen-awesome-paragraph-link.js"></script>
<script type="text/javascript">
DoxygenAwesomeDarkModeToggle.init()
DoxygenAwesomeFragmentCopyButton.init()
DoxygenAwesomeInteractiveToc.init()
DoxygenAwesomeParagraphLink.init()
</script>
<link href="navtree.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="navtreedata.js"></script>
<script type="text/javascript" src="navtree.js"></script>
<script type="text/javascript" src="cookie.js"></script>
<link href="search/search.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="search/searchdata.js"></script>
<script type="text/javascript" src="search/search.js"></script>
<link href="doxygen.css" rel="stylesheet" type="text/css" />
<link href="doxygen-awesome.css" rel="stylesheet" type="text/css"/>
<link href="doxygen-awesome-sidebar-only.css" rel="stylesheet" type="text/css"/>
<link href="doxygen-awesome-sidebar-only-darkmode-toggle.css" rel="stylesheet" type="text/css"/>
<link href="doxygen-awesome-interactive-toc.js" rel="stylesheet" type="text/css"/>
<link href="custom.css" rel="stylesheet" type="text/css"/>
<link href="version-switcher.css" rel="stylesheet" type="text/css"/>
</head>
<body>
<!-- https://tholman.com/github-corners/ -->
<a href="https://github.com/mimir/mimir" class="github-corner" title="View source on GitHub">
<svg viewBox="0 0 250 250" style="position: absolute; top: 0; border: 0; right: 0;" aria-hidden="true">
<path d="M0,0 L115,115 L130,115 L142,142 L250,250 L250,0 Z"></path><path d="M128.3,109.0 C113.8,99.7 119.0,89.6 119.0,89.6 C122.0,82.7 120.5,78.6 120.5,78.6 C119.2,72.0 123.4,76.3 123.4,76.3 C127.3,80.9 125.5,87.3 125.5,87.3 C122.9,97.6 130.6,101.9 134.4,103.2" fill="currentColor" style="transform-origin: 130px 106px;" class="octo-arm"></path><path d="M115.0,115.0 C114.9,115.1 118.7,116.5 119.8,115.4 L133.7,101.6 C136.9,99.2 139.9,98.4 142.2,98.6 C133.8,88.0 127.5,74.4 143.8,58.0 C148.5,53.4 154.0,51.2 159.7,51.0 C160.3,49.4 163.2,43.6 171.4,40.1 C171.4,40.1 176.1,42.5 178.8,56.2 C183.1,58.6 187.2,61.8 190.9,65.4 C194.5,69.0 197.7,73.2 200.1,77.6 C213.8,80.2 216.3,84.9 216.3,84.9 C212.7,93.1 206.9,96.0 205.4,96.6 C205.1,102.4 203.0,107.8 198.3,112.5 C181.9,128.9 168.3,122.5 157.7,114.1 C157.9,116.9 156.7,120.9 152.7,124.9 L141.0,136.5 C139.8,137.7 141.6,141.9 141.8,141.8 Z" fill="currentColor" class="octo-body"></path></svg></a><style>.github-corner:hover .octo-arm{animation:octocat-wave 560ms ease-in-out}@keyframes octocat-wave{0%,100%{transform:rotate(0)}20%,60%{transform:rotate(-25deg)}40%,80%{transform:rotate(10deg)}}@media (max-width:500px){.github-corner:hover .octo-arm{animation:none}.github-corner .octo-arm{animation:octocat-wave 560ms ease-in-out}}</style>
<div id="top"><!-- do not remove this div, it is closed by doxygen! -->
<div id="titlearea">
<table cellspacing="0" cellpadding="0">
<tbody>
<tr id="projectrow">
<td id="projectlogo"><img alt="Logo" src="logo.svg"/></td>
<td id="projectalign">
<div id="projectname">MimIR
<div id="projectnumber" class="version-switcher" data-manifest="versions.json">
<button class="version-switcher__button" type="button" aria-expanded="false" aria-haspopup="true">0.2-dev</button>
<div class="version-switcher__menu" hidden></div>
</div>
<script type="text/javascript" src="version-switcher.js"></script>
</div>
<div id="projectbrief">MimIR is my Intermediate Representation</div>
</td>
</tr>
</tbody>
</table>
</div>
<!-- end header part -->
<!-- Generated by Doxygen 1.16.1 -->
<script type="text/javascript">
var searchBox = new SearchBox("searchBox", "search/",'.html');
</script>
<script type="text/javascript">
$(function() { codefold.init(); });
</script>
<script type="text/javascript" src="menudata.js"></script>
<script type="text/javascript" src="menu.js"></script>
<script type="text/javascript">
$(function() {
initMenu('',true,false,'search.php','Search',true);
$(function() { init_search(); });
});
</script>
<div id="main-nav"></div>
</div><!-- top -->
<div id="side-nav" class="ui-resizable side-nav-resizable">
<div id="nav-tree">
<div id="nav-tree-contents">
<div id="nav-sync" class="sync"></div>
</div>
</div>
<div id="splitbar" style="-moz-user-select:none;"
class="ui-resizable-handle">
</div>
</div>
<script type="text/javascript">
$(function(){initNavTree('autodiff_8cpp_source.html','',''); });
</script>
<div id="container">
<div id="doc-content">
<!-- window showing the filter options -->
<div id="MSearchSelectWindow"
onmouseover="return searchBox.OnSearchSelectShow()"
onmouseout="return searchBox.OnSearchSelectHide()"
onkeydown="return searchBox.OnSearchSelectKey(event)">
</div>
<!-- iframe showing the search results (closed by default) -->
<div id="MSearchResultsWindow">
<div id="MSearchResults">
<div class="SRPage">
<div id="SRIndex">
<div id="SRResults"></div>
<div class="SRStatus" id="Loading">Loading...</div>
<div class="SRStatus" id="Searching">Searching...</div>
<div class="SRStatus" id="NoMatches">No Matches</div>
</div>
</div>
</div>
</div>
<div class="header">
<div class="headertitle"><div class="title">autodiff.cpp</div></div>
</div><!--header-->
<div class="contents">
<a href="autodiff_8cpp.html">Go to the documentation of this file.</a><div class="fragment"><div class="line"><a id="l00001" name="l00001"></a><span class="lineno"> 1</span><span class="preprocessor">#include "<a class="code" href="autodiff_8h.html">mim/plug/autodiff/autodiff.h</a>"</span></div>
<div class="line"><a id="l00002" name="l00002"></a><span class="lineno"> 2</span> </div>
<div class="line"><a id="l00003" name="l00003"></a><span class="lineno"> 3</span><span class="preprocessor">#include <<a class="code" href="config_8h.html">mim/config.h</a>></span></div>
<div class="line"><a id="l00004" name="l00004"></a><span class="lineno"> 4</span><span class="preprocessor">#include <<a class="code" href="phase_8h.html">mim/phase.h</a>></span></div>
<div class="line"><a id="l00005" name="l00005"></a><span class="lineno"> 5</span> </div>
<div class="line"><a id="l00006" name="l00006"></a><span class="lineno"> 6</span><span class="preprocessor">#include <<a class="code" href="mem_8h.html">mim/plug/mem/mem.h</a>></span></div>
<div class="line"><a id="l00007" name="l00007"></a><span class="lineno"> 7</span> </div>
<div class="line"><a id="l00008" name="l00008"></a><span class="lineno"> 8</span><span class="preprocessor">#include "<a class="code" href="eval_8h.html">mim/plug/autodiff/pass/eval.h</a>"</span></div>
<div class="line"><a id="l00009" name="l00009"></a><span class="lineno"> 9</span> </div>
<div class="line"><a id="l00010" name="l00010"></a><span class="lineno"> 10</span><span class="keyword">using namespace </span>std::literals;</div>
<div class="line"><a id="l00011" name="l00011"></a><span class="lineno"> 11</span><span class="keyword">using namespace </span><a class="code hl_namespace" href="namespacemim.html">mim</a>;</div>
<div class="line"><a id="l00012" name="l00012"></a><span class="lineno"> 12</span><span class="keyword">using namespace </span><a class="code hl_namespace" href="namespacemim_1_1plug.html">mim::plug</a>;</div>
<div class="line"><a id="l00013" name="l00013"></a><span class="lineno"> 13</span> </div>
<div class="foldopen" id="foldopen00014" data-start="{" data-end="}">
<div class="line"><a id="l00014" name="l00014"></a><span class="lineno"><a class="line" href="autodiff_8cpp.html#a3886e4c865b2b15eae2cc4c6f84a9176"> 14</a></span><span class="keywordtype">void</span> <a class="code hl_function" href="autodiff_8cpp.html#a3886e4c865b2b15eae2cc4c6f84a9176">reg_stages</a>(<a class="code hl_typedef" href="namespacemim.html#a73c02685bc8b4078797ffde79a9c1ac9">Flags2Stages</a>& stages) {</div>
<div class="line"><a id="l00015" name="l00015"></a><span class="lineno"> 15</span> <a class="code hl_function" href="classmim_1_1Stage.html#aaf397a927e480d7c69023d39441e7a90">Stage::hook<autodiff::eval_pass, autodiff::Eval></a>(stages);</div>
<div class="line"><a id="l00016" name="l00016"></a><span class="lineno"> 16</span> </div>
<div class="line"><a id="l00017" name="l00017"></a><span class="lineno"> 17</span> <a class="code hl_define" href="phase_8h.html#a10fe6dd6766d951ff89316abd71620de">MIM_REPL</a>(stages, <a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a12e6386bac07e09fa61550bfa5631b9d">autodiff::zero_repl</a>, {</div>
<div class="line"><a id="l00018" name="l00018"></a><span class="lineno"> 18</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> zero = <a class="code hl_function" href="classmim_1_1Axm.html#a606d1a978089ad57ff1369cb233f6338">Axm::isa<autodiff::zero></a>(def); zero) {</div>
<div class="line"><a id="l00019" name="l00019"></a><span class="lineno"> 19</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> z = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a5fbb31cd7dee586d07837fc5c55eed78">autodiff::zero_def</a>(zero->arg())) <span class="keywordflow">return</span> z;</div>
<div class="line"><a id="l00020" name="l00020"></a><span class="lineno"> 20</span> }</div>
<div class="line"><a id="l00021" name="l00021"></a><span class="lineno"> 21</span> <span class="keywordflow">return</span> {};</div>
<div class="line"><a id="l00022" name="l00022"></a><span class="lineno"> 22</span> });</div>
<div class="line"><a id="l00023" name="l00023"></a><span class="lineno"> 23</span>}</div>
</div>
<div class="line"><a id="l00024" name="l00024"></a><span class="lineno"> 24</span> </div>
<div class="foldopen" id="foldopen00025" data-start="{" data-end="}">
<div class="line"><a id="l00025" name="l00025"></a><span class="lineno"><a class="line" href="autodiff_8cpp.html#a35bb34350e93d508e52544f4abd50e59"> 25</a></span><span class="keyword">extern</span> <span class="stringliteral">"C"</span> <a class="code hl_define" href="config_8h.html#acf14f602e3976ff8653bb419a1d77a7f">MIM_EXPORT</a> <a class="code hl_struct" href="structmim_1_1Plugin.html">Plugin</a> <a class="code hl_function" href="namespacemim.html#a77f34c28f8418e4828b4684cbc025e52">mim_get_plugin</a>() {</div>
<div class="line"><a id="l00026" name="l00026"></a><span class="lineno"> 26</span> <span class="keywordflow">return</span> {<span class="stringliteral">"autodiff"</span>, <a class="code hl_define" href="plugin_8h.html#a2f1c22749113d1954fe381a30a0d5bb2">MIM_VERSION</a>, [](<a class="code hl_typedef" href="namespacemim.html#ab875464e5f495601abff7287573e1405">Normalizers</a>& n) { <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#ae559e1df7e384d843cb9e1951c7d1d90">autodiff::register_normalizers</a>(n); }, <a class="code hl_function" href="affine_8cpp.html#a3886e4c865b2b15eae2cc4c6f84a9176">reg_stages</a>, <span class="keyword">nullptr</span>};</div>
<div class="line"><a id="l00027" name="l00027"></a><span class="lineno"> 27</span>}</div>
</div>
<div class="line"><a id="l00028" name="l00028"></a><span class="lineno"> 28</span> </div>
<div class="line"><a id="l00029" name="l00029"></a><span class="lineno"> 29</span><span class="keyword">namespace </span><a class="code hl_namespace" href="namespacemim_1_1plug_1_1autodiff.html">mim::plug::autodiff</a> {</div>
<div class="foldopen" id="foldopen00030" data-start="{" data-end="}">
<div class="line"><a id="l00030" name="l00030"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a968c053d85aa0d5c782ca7bacb51e727"> 30</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a968c053d85aa0d5c782ca7bacb51e727">id_pullback</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* A) {</div>
<div class="line"><a id="l00031" name="l00031"></a><span class="lineno"> 31</span> <span class="keyword">auto</span>& world = A-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00032" name="l00032"></a><span class="lineno"> 32</span> <span class="keyword">auto</span> arg_pb_ty = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#aea750f837c2ff1b730c268bf3c88cb26">pullback_type</a>(A, A);</div>
<div class="line"><a id="l00033" name="l00033"></a><span class="lineno"> 33</span> <span class="keyword">auto</span> id_pb = world.mut_lam(arg_pb_ty)->set(<span class="stringliteral">"id_pb"</span>);</div>
<div class="line"><a id="l00034" name="l00034"></a><span class="lineno"> 34</span> <span class="keyword">auto</span> id_pb_scalar = id_pb->var(0_s)->set(<span class="stringliteral">"s"</span>);</div>
<div class="line"><a id="l00035" name="l00035"></a><span class="lineno"> 35</span> id_pb->app(<span class="keyword">true</span>,</div>
<div class="line"><a id="l00036" name="l00036"></a><span class="lineno"> 36</span> id_pb->var(1), <span class="comment">// can not use ret_var as the result might be higher order</span></div>
<div class="line"><a id="l00037" name="l00037"></a><span class="lineno"> 37</span> id_pb_scalar);</div>
<div class="line"><a id="l00038" name="l00038"></a><span class="lineno"> 38</span> </div>
<div class="line"><a id="l00039" name="l00039"></a><span class="lineno"> 39</span> <span class="keywordflow">return</span> id_pb;</div>
<div class="line"><a id="l00040" name="l00040"></a><span class="lineno"> 40</span>}</div>
</div>
<div class="line"><a id="l00041" name="l00041"></a><span class="lineno"> 41</span> </div>
<div class="foldopen" id="foldopen00042" data-start="{" data-end="}">
<div class="line"><a id="l00042" name="l00042"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a7d78f8fc3e4b05738330a02f7f8502e9"> 42</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a7d78f8fc3e4b05738330a02f7f8502e9">zero_pullback</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* E, <span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* A) {</div>
<div class="line"><a id="l00043" name="l00043"></a><span class="lineno"> 43</span> <span class="keyword">auto</span>& world = A-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00044" name="l00044"></a><span class="lineno"> 44</span> <span class="keyword">auto</span> A_tangent = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a68aae344814c11b1359c6b945f109153">tangent_type_fun</a>(A);</div>
<div class="line"><a id="l00045" name="l00045"></a><span class="lineno"> 45</span> <span class="keyword">auto</span> pb_ty = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#aea750f837c2ff1b730c268bf3c88cb26">pullback_type</a>(E, A);</div>
<div class="line"><a id="l00046" name="l00046"></a><span class="lineno"> 46</span> <span class="keyword">auto</span> pb = world.mut_lam(pb_ty)->set(<span class="stringliteral">"zero_pb"</span>);</div>
<div class="line"><a id="l00047" name="l00047"></a><span class="lineno"> 47</span> world.DLOG(<span class="stringliteral">"zero_pullback for {} resp. {} (-> {})"</span>, E, A, A_tangent);</div>
<div class="line"><a id="l00048" name="l00048"></a><span class="lineno"> 48</span> pb->app(<span class="keyword">true</span>, pb->var(1), world.call<<a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a1e3297839dced2ccc616d130b6404148">zero</a>>(A_tangent));</div>
<div class="line"><a id="l00049" name="l00049"></a><span class="lineno"> 49</span> <span class="keywordflow">return</span> pb;</div>
<div class="line"><a id="l00050" name="l00050"></a><span class="lineno"> 50</span>}</div>
</div>
<div class="line"><a id="l00051" name="l00051"></a><span class="lineno"> 51</span> </div>
<div class="line"><a id="l00052" name="l00052"></a><span class="lineno"> 52</span><span class="comment">// `P` => `P*`</span></div>
<div class="line"><a id="l00053" name="l00053"></a><span class="lineno"> 53</span><span class="comment">// TODO: nothing? function => R? Mem => R?</span></div>
<div class="line"><a id="l00054" name="l00054"></a><span class="lineno"> 54</span><span class="comment">// TODO: rename to op_tangent_type</span></div>
<div class="line"><a id="l00055" name="l00055"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a68aae344814c11b1359c6b945f109153"> 55</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a68aae344814c11b1359c6b945f109153">tangent_type_fun</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* ty) { <span class="keywordflow">return</span> ty; }</div>
<div class="line"><a id="l00056" name="l00056"></a><span class="lineno"> 56</span><span class="comment"></span> </div>
<div class="line"><a id="l00057" name="l00057"></a><span class="lineno"> 57</span><span class="comment">/// computes pb type `E* -> A*`</span></div>
<div class="line"><a id="l00058" name="l00058"></a><span class="lineno"> 58</span><span class="comment">/// `E` - type of the expression (return type for a function)</span></div>
<div class="line"><a id="l00059" name="l00059"></a><span class="lineno"> 59</span><span class="comment">/// `A` - type of the argument (point of orientation resp. derivative - argument type for partial pullbacks)</span></div>
<div class="foldopen" id="foldopen00060" data-start="{" data-end="}">
<div class="line"><a id="l00060" name="l00060"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#aea750f837c2ff1b730c268bf3c88cb26"> 60</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#aea750f837c2ff1b730c268bf3c88cb26">pullback_type</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* E, <span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* A) {</div>
<div class="line"><a id="l00061" name="l00061"></a><span class="lineno"> 61</span> <span class="keyword">auto</span>& world = E-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00062" name="l00062"></a><span class="lineno"> 62</span> <span class="keyword">auto</span> tang_arg = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a68aae344814c11b1359c6b945f109153">tangent_type_fun</a>(A);</div>
<div class="line"><a id="l00063" name="l00063"></a><span class="lineno"> 63</span> <span class="keyword">auto</span> tang_ret = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a68aae344814c11b1359c6b945f109153">tangent_type_fun</a>(E);</div>
<div class="line"><a id="l00064" name="l00064"></a><span class="lineno"> 64</span> <span class="keyword">auto</span> pb_ty = world.cn({tang_ret, world.cn(tang_arg)});</div>
<div class="line"><a id="l00065" name="l00065"></a><span class="lineno"> 65</span> <span class="keywordflow">return</span> pb_ty;</div>
<div class="line"><a id="l00066" name="l00066"></a><span class="lineno"> 66</span>}</div>
</div>
<div class="line"><a id="l00067" name="l00067"></a><span class="lineno"> 67</span> </div>
<div class="line"><a id="l00068" name="l00068"></a><span class="lineno"> 68</span><span class="keyword">namespace </span>{</div>
<div class="line"><a id="l00069" name="l00069"></a><span class="lineno"> 69</span><span class="comment">// `A,R` => `(A->R)' = A' -> R' * (R* -> A*)`</span></div>
<div class="line"><a id="l00070" name="l00070"></a><span class="lineno"> 70</span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* arg, <span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* ret) {</div>
<div class="line"><a id="l00071" name="l00071"></a><span class="lineno"> 71</span> <span class="keyword">auto</span>& world = arg-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00072" name="l00072"></a><span class="lineno"> 72</span> world.DLOG(<span class="stringliteral">"autodiff type for {} => {}"</span>, arg, ret);</div>
<div class="line"><a id="l00073" name="l00073"></a><span class="lineno"> 73</span> <span class="keyword">auto</span> aug_arg = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">mim::plug::autodiff::autodiff_type_fun</a>(arg);</div>
<div class="line"><a id="l00074" name="l00074"></a><span class="lineno"> 74</span> <span class="keyword">auto</span> aug_ret = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">mim::plug::autodiff::autodiff_type_fun</a>(ret);</div>
<div class="line"><a id="l00075" name="l00075"></a><span class="lineno"> 75</span> world.DLOG(<span class="stringliteral">"augmented types: {} => {}"</span>, aug_arg, aug_ret);</div>
<div class="line"><a id="l00076" name="l00076"></a><span class="lineno"> 76</span> <span class="keywordflow">if</span> (!aug_arg || !aug_ret) <span class="keywordflow">return</span> <span class="keyword">nullptr</span>;</div>
<div class="line"><a id="l00077" name="l00077"></a><span class="lineno"> 77</span> <span class="comment">// `Q* -> P*`</span></div>
<div class="line"><a id="l00078" name="l00078"></a><span class="lineno"> 78</span> <span class="keyword">auto</span> pb_ty = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#aea750f837c2ff1b730c268bf3c88cb26">pullback_type</a>(ret, arg);</div>
<div class="line"><a id="l00079" name="l00079"></a><span class="lineno"> 79</span> world.DLOG(<span class="stringliteral">"pb type: {}"</span>, pb_ty);</div>
<div class="line"><a id="l00080" name="l00080"></a><span class="lineno"> 80</span> <span class="comment">// `P' -> Q' * (Q* -> P*)`</span></div>
<div class="line"><a id="l00081" name="l00081"></a><span class="lineno"> 81</span> </div>
<div class="line"><a id="l00082" name="l00082"></a><span class="lineno"> 82</span> <span class="keyword">auto</span> deriv_ty = world.cn({aug_arg, world.cn({aug_ret, pb_ty})});</div>
<div class="line"><a id="l00083" name="l00083"></a><span class="lineno"> 83</span> world.DLOG(<span class="stringliteral">"autodiff type: {}"</span>, deriv_ty);</div>
<div class="line"><a id="l00084" name="l00084"></a><span class="lineno"> 84</span> <span class="keywordflow">return</span> deriv_ty;</div>
<div class="line"><a id="l00085" name="l00085"></a><span class="lineno"> 85</span>}</div>
<div class="line"><a id="l00086" name="l00086"></a><span class="lineno"> 86</span>} <span class="comment">// namespace</span></div>
<div class="line"><a id="l00087" name="l00087"></a><span class="lineno"> 87</span> </div>
<div class="foldopen" id="foldopen00088" data-start="{" data-end="}">
<div class="line"><a id="l00088" name="l00088"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a0147856a9a811ec390d08298087df30e"> 88</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a0147856a9a811ec390d08298087df30e">autodiff_type_fun_pi</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>* pi) {</div>
<div class="line"><a id="l00089" name="l00089"></a><span class="lineno"> 89</span> <span class="keyword">auto</span>& world = pi-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00090" name="l00090"></a><span class="lineno"> 90</span> <span class="keywordflow">if</span> (!<a class="code hl_function" href="classmim_1_1Pi.html#a60c2d05d18e618930742433ce71e0a61">Pi::isa_cn</a>(pi)) {</div>
<div class="line"><a id="l00091" name="l00091"></a><span class="lineno"> 91</span> <span class="comment">// TODO: dependency</span></div>
<div class="line"><a id="l00092" name="l00092"></a><span class="lineno"> 92</span> <span class="keyword">auto</span> arg = pi-><a class="code hl_function" href="classmim_1_1Pi.html#a7941d7dac71f378682c9303de3e45e27">dom</a>();</div>
<div class="line"><a id="l00093" name="l00093"></a><span class="lineno"> 93</span> <span class="keyword">auto</span> ret = pi-><a class="code hl_function" href="classmim_1_1Pi.html#a826161c3dae157a2aa1c273f71f0a8c2">codom</a>();</div>
<div class="line"><a id="l00094" name="l00094"></a><span class="lineno"> 94</span> <span class="keywordflow">if</span> (ret->isa<<a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>>()) {</div>
<div class="line"><a id="l00095" name="l00095"></a><span class="lineno"> 95</span> <span class="keyword">auto</span> aug_arg = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(arg);</div>
<div class="line"><a id="l00096" name="l00096"></a><span class="lineno"> 96</span> <span class="keywordflow">if</span> (!aug_arg) <span class="keywordflow">return</span> <span class="keyword">nullptr</span>;</div>
<div class="line"><a id="l00097" name="l00097"></a><span class="lineno"> 97</span> <span class="keyword">auto</span> aug_ret = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(pi-><a class="code hl_function" href="classmim_1_1Pi.html#a826161c3dae157a2aa1c273f71f0a8c2">codom</a>());</div>
<div class="line"><a id="l00098" name="l00098"></a><span class="lineno"> 98</span> <span class="keywordflow">if</span> (!aug_ret) <span class="keywordflow">return</span> <span class="keyword">nullptr</span>;</div>
<div class="line"><a id="l00099" name="l00099"></a><span class="lineno"> 99</span> <span class="keywordflow">return</span> world.pi(aug_arg, aug_ret);</div>
<div class="line"><a id="l00100" name="l00100"></a><span class="lineno"> 100</span> }</div>
<div class="line"><a id="l00101" name="l00101"></a><span class="lineno"> 101</span> <span class="keywordflow">return</span> <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(arg, ret);</div>
<div class="line"><a id="l00102" name="l00102"></a><span class="lineno"> 102</span> }</div>
<div class="line"><a id="l00103" name="l00103"></a><span class="lineno"> 103</span> <span class="keyword">auto</span> [arg, ret_pi] = pi->doms<2>();</div>
<div class="line"><a id="l00104" name="l00104"></a><span class="lineno"> 104</span> <span class="keyword">auto</span> ret = ret_pi->as<<a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>>()->dom();</div>
<div class="line"><a id="l00105" name="l00105"></a><span class="lineno"> 105</span> world.DLOG(<span class="stringliteral">"compute AD type for pi"</span>);</div>
<div class="line"><a id="l00106" name="l00106"></a><span class="lineno"> 106</span> <span class="keywordflow">return</span> <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(arg, ret);</div>
<div class="line"><a id="l00107" name="l00107"></a><span class="lineno"> 107</span>}</div>
</div>
<div class="line"><a id="l00108" name="l00108"></a><span class="lineno"> 108</span> </div>
<div class="line"><a id="l00109" name="l00109"></a><span class="lineno"> 109</span><span class="comment">// In general transforms `A` => `A'`.</span></div>
<div class="line"><a id="l00110" name="l00110"></a><span class="lineno"> 110</span><span class="comment">// Especially `P->Q` => `P'->Q' * (Q* -> P*)`.</span></div>
<div class="foldopen" id="foldopen00111" data-start="{" data-end="}">
<div class="line"><a id="l00111" name="l00111"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7"> 111</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* ty) {</div>
<div class="line"><a id="l00112" name="l00112"></a><span class="lineno"> 112</span> <span class="keyword">auto</span>& world = ty-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00113" name="l00113"></a><span class="lineno"> 113</span> <span class="comment">// TODO: handle DS (operators)</span></div>
<div class="line"><a id="l00114" name="l00114"></a><span class="lineno"> 114</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> pi = ty->isa<<a class="code hl_class" href="classmim_1_1Pi.html">Pi</a>>()) <span class="keywordflow">return</span> <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a0147856a9a811ec390d08298087df30e">autodiff_type_fun_pi</a>(pi);</div>
<div class="line"><a id="l00115" name="l00115"></a><span class="lineno"> 115</span> <span class="comment">// Also handles autodiff call from axm declaration => abstract => leave it.</span></div>
<div class="line"><a id="l00116" name="l00116"></a><span class="lineno"> 116</span> world.DLOG(<span class="stringliteral">"AutoDiff on type: {} <{}>"</span>, ty, ty-><a class="code hl_function" href="classmim_1_1Def.html#a361f116b80b8b8fd1eac9a22e34564b0">node_name</a>());</div>
<div class="line"><a id="l00117" name="l00117"></a><span class="lineno"> 117</span> <span class="keywordflow">if</span> (<a class="code hl_function" href="classmim_1_1Idx.html#a7b4496e71deaa94835f732de364e5d76">Idx::isa</a>(ty)) <span class="keywordflow">return</span> ty;</div>
<div class="line"><a id="l00118" name="l00118"></a><span class="lineno"> 118</span> <span class="keywordflow">if</span> (ty == world.type_nat()) <span class="keywordflow">return</span> ty;</div>
<div class="line"><a id="l00119" name="l00119"></a><span class="lineno"> 119</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> arr = ty->isa<<a class="code hl_class" href="classmim_1_1Arr.html">Arr</a>>()) {</div>
<div class="line"><a id="l00120" name="l00120"></a><span class="lineno"> 120</span> <span class="keyword">auto</span> shape = arr->arity();</div>
<div class="line"><a id="l00121" name="l00121"></a><span class="lineno"> 121</span> <span class="keyword">auto</span> body = arr->body();</div>
<div class="line"><a id="l00122" name="l00122"></a><span class="lineno"> 122</span> <span class="keyword">auto</span> body_ad = <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">autodiff_type_fun</a>(body);</div>
<div class="line"><a id="l00123" name="l00123"></a><span class="lineno"> 123</span> <span class="keywordflow">if</span> (!body_ad) <span class="keywordflow">return</span> <span class="keyword">nullptr</span>;</div>
<div class="line"><a id="l00124" name="l00124"></a><span class="lineno"> 124</span> <span class="keywordflow">return</span> world.arr(shape, body_ad);</div>
<div class="line"><a id="l00125" name="l00125"></a><span class="lineno"> 125</span> }</div>
<div class="line"><a id="l00126" name="l00126"></a><span class="lineno"> 126</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> sig = ty->isa<<a class="code hl_class" href="classmim_1_1Sigma.html">Sigma</a>>()) {</div>
<div class="line"><a id="l00127" name="l00127"></a><span class="lineno"> 127</span> <span class="comment">// TODO: mut sigma</span></div>
<div class="line"><a id="l00128" name="l00128"></a><span class="lineno"> 128</span> <span class="keyword">auto</span> ops = <a class="code hl_typedef" href="namespacemim.html#a1433b0566b2cbdbf0c6f74baed22bb52">DefVec</a>(sig->ops(), [&](<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* op) { return autodiff_type_fun(op); });</div>
<div class="line"><a id="l00129" name="l00129"></a><span class="lineno"> 129</span> world.DLOG(<span class="stringliteral">"ops: {,}"</span>, ops);</div>
<div class="line"><a id="l00130" name="l00130"></a><span class="lineno"> 130</span> <span class="keywordflow">return</span> world.sigma(ops);</div>
<div class="line"><a id="l00131" name="l00131"></a><span class="lineno"> 131</span> }</div>
<div class="line"><a id="l00132" name="l00132"></a><span class="lineno"> 132</span> <span class="comment">// mem</span></div>
<div class="line"><a id="l00133" name="l00133"></a><span class="lineno"> 133</span> <span class="keywordflow">if</span> (<a class="code hl_function" href="classmim_1_1Axm.html#a606d1a978089ad57ff1369cb233f6338">Axm::isa<mem::M></a>(ty)) <span class="keywordflow">return</span> ty;</div>
<div class="line"><a id="l00134" name="l00134"></a><span class="lineno"> 134</span> world.WLOG(<span class="stringliteral">"no-diff type: {}"</span>, ty);</div>
<div class="line"><a id="l00135" name="l00135"></a><span class="lineno"> 135</span> <span class="keywordflow">return</span> <span class="keyword">nullptr</span>;</div>
<div class="line"><a id="l00136" name="l00136"></a><span class="lineno"> 136</span>}</div>
</div>
<div class="line"><a id="l00137" name="l00137"></a><span class="lineno"> 137</span> </div>
<div class="foldopen" id="foldopen00138" data-start="{" data-end="}">
<div class="line"><a id="l00138" name="l00138"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a5fbb31cd7dee586d07837fc5c55eed78"> 138</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a5fbb31cd7dee586d07837fc5c55eed78">zero_def</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* T) {</div>
<div class="line"><a id="l00139" name="l00139"></a><span class="lineno"> 139</span> <span class="comment">// TODO: we want: zero mem -> zero mem or bot</span></div>
<div class="line"><a id="l00140" name="l00140"></a><span class="lineno"> 140</span> <span class="comment">// zero [A,B,C] -> [zero A, zero B, zero C]</span></div>
<div class="line"><a id="l00141" name="l00141"></a><span class="lineno"> 141</span> <span class="keyword">auto</span>& world = T-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00142" name="l00142"></a><span class="lineno"> 142</span> world.DLOG(<span class="stringliteral">"zero_def for type {} <{}>"</span>, T, T-><a class="code hl_function" href="classmim_1_1Def.html#a361f116b80b8b8fd1eac9a22e34564b0">node_name</a>());</div>
<div class="line"><a id="l00143" name="l00143"></a><span class="lineno"> 143</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> arr = T->isa<<a class="code hl_class" href="classmim_1_1Arr.html">Arr</a>>()) {</div>
<div class="line"><a id="l00144" name="l00144"></a><span class="lineno"> 144</span> <span class="keyword">auto</span> arity = arr->arity();</div>
<div class="line"><a id="l00145" name="l00145"></a><span class="lineno"> 145</span> <span class="keyword">auto</span> body = arr->body();</div>
<div class="line"><a id="l00146" name="l00146"></a><span class="lineno"> 146</span> <span class="keyword">auto</span> inner_zero = world.app(world.annex<<a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a1e3297839dced2ccc616d130b6404148">zero</a>>(), body);</div>
<div class="line"><a id="l00147" name="l00147"></a><span class="lineno"> 147</span> <span class="keyword">auto</span> zero_arr = world.pack(arity, inner_zero);</div>
<div class="line"><a id="l00148" name="l00148"></a><span class="lineno"> 148</span> world.DLOG(<span class="stringliteral">"zero_def for array of shape {} with type {}"</span>, arity, body);</div>
<div class="line"><a id="l00149" name="l00149"></a><span class="lineno"> 149</span> world.DLOG(<span class="stringliteral">"zero_arr: {}"</span>, zero_arr);</div>
<div class="line"><a id="l00150" name="l00150"></a><span class="lineno"> 150</span> <span class="keywordflow">return</span> zero_arr;</div>
<div class="line"><a id="l00151" name="l00151"></a><span class="lineno"> 151</span> } <span class="keywordflow">else</span> <span class="keywordflow">if</span> (<a class="code hl_function" href="classmim_1_1Idx.html#a7b4496e71deaa94835f732de364e5d76">Idx::isa</a>(T)) {</div>
<div class="line"><a id="l00152" name="l00152"></a><span class="lineno"> 152</span> <span class="comment">// TODO: real</span></div>
<div class="line"><a id="l00153" name="l00153"></a><span class="lineno"> 153</span> <span class="keyword">auto</span> <a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a1e3297839dced2ccc616d130b6404148">zero</a> = world.lit(T, 0)->set(<span class="stringliteral">"zero"</span>);</div>
<div class="line"><a id="l00154" name="l00154"></a><span class="lineno"> 154</span> world.DLOG(<span class="stringliteral">"zero_def for int is {}"</span>, <a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a1e3297839dced2ccc616d130b6404148">zero</a>);</div>
<div class="line"><a id="l00155" name="l00155"></a><span class="lineno"> 155</span> <span class="keywordflow">return</span> <a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a1e3297839dced2ccc616d130b6404148">zero</a>;</div>
<div class="line"><a id="l00156" name="l00156"></a><span class="lineno"> 156</span> } <span class="keywordflow">else</span> <span class="keywordflow">if</span> (<span class="keyword">auto</span> sig = T->isa<<a class="code hl_class" href="classmim_1_1Sigma.html">Sigma</a>>()) {</div>
<div class="line"><a id="l00157" name="l00157"></a><span class="lineno"> 157</span> <span class="keyword">auto</span> ops = <a class="code hl_typedef" href="namespacemim.html#a1433b0566b2cbdbf0c6f74baed22bb52">DefVec</a>(sig->ops(), [&](<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* op) { return world.app(world.annex<zero>(), op); });</div>
<div class="line"><a id="l00158" name="l00158"></a><span class="lineno"> 158</span> <span class="keywordflow">return</span> world.tuple(ops);</div>
<div class="line"><a id="l00159" name="l00159"></a><span class="lineno"> 159</span> }</div>
<div class="line"><a id="l00160" name="l00160"></a><span class="lineno"> 160</span> </div>
<div class="line"><a id="l00161" name="l00161"></a><span class="lineno"> 161</span> <span class="comment">// or return bot</span></div>
<div class="line"><a id="l00162" name="l00162"></a><span class="lineno"> 162</span> <span class="comment">// or id => zero T</span></div>
<div class="line"><a id="l00163" name="l00163"></a><span class="lineno"> 163</span> <span class="comment">// return world.app(world.annex<zero>(), T);</span></div>
<div class="line"><a id="l00164" name="l00164"></a><span class="lineno"> 164</span> <span class="keywordflow">return</span> <span class="keyword">nullptr</span>;</div>
<div class="line"><a id="l00165" name="l00165"></a><span class="lineno"> 165</span>}</div>
</div>
<div class="line"><a id="l00166" name="l00166"></a><span class="lineno"> 166</span> </div>
<div class="foldopen" id="foldopen00167" data-start="{" data-end="}">
<div class="line"><a id="l00167" name="l00167"></a><span class="lineno"><a class="line" href="namespacemim_1_1plug_1_1autodiff.html#a0dc86993105c5eda1d3a217ba20ce699"> 167</a></span><span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* <a class="code hl_function" href="namespacemim_1_1plug_1_1autodiff.html#a0dc86993105c5eda1d3a217ba20ce699">op_sum</a>(<span class="keyword">const</span> <a class="code hl_class" href="classmim_1_1Def.html">Def</a>* T, <a class="code hl_typedef" href="namespacemim.html#a00e263b7dcc231b14adcf75ff1ab1740">Defs</a> defs) {</div>
<div class="line"><a id="l00168" name="l00168"></a><span class="lineno"> 168</span> <span class="comment">// TODO: assert all are of type T</span></div>
<div class="line"><a id="l00169" name="l00169"></a><span class="lineno"> 169</span> <span class="keyword">auto</span>& world = T-><a class="code hl_function" href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">world</a>();</div>
<div class="line"><a id="l00170" name="l00170"></a><span class="lineno"> 170</span> <span class="keywordflow">return</span> world.<a class="code hl_function" href="classmim_1_1World.html#a41d6416de4c8ec665cb15c3ca7db77e6">app</a>(world.app(world.annex<<a class="code hl_enumeration" href="namespacemim_1_1plug_1_1autodiff.html#a27536fa48373a84728e55704e659a420">sum</a>>(), {world.lit_nat(defs.size()), T}), defs);</div>
<div class="line"><a id="l00171" name="l00171"></a><span class="lineno"> 171</span>}</div>
</div>
<div class="line"><a id="l00172" name="l00172"></a><span class="lineno"> 172</span> </div>
<div class="line"><a id="l00173" name="l00173"></a><span class="lineno"> 173</span>} <span class="comment">// namespace mim::plug::autodiff</span></div>
<div class="ttc" id="aaffine_8cpp_html_a3886e4c865b2b15eae2cc4c6f84a9176"><div class="ttname"><a href="affine_8cpp.html#a3886e4c865b2b15eae2cc4c6f84a9176">reg_stages</a></div><div class="ttdeci">void reg_stages(Flags2Stages &stages)</div><div class="ttdef"><b>Definition</b> <a href="affine_8cpp_source.html#l00011">affine.cpp:11</a></div></div>
<div class="ttc" id="aautodiff_8cpp_html_a3886e4c865b2b15eae2cc4c6f84a9176"><div class="ttname"><a href="autodiff_8cpp.html#a3886e4c865b2b15eae2cc4c6f84a9176">reg_stages</a></div><div class="ttdeci">void reg_stages(Flags2Stages &stages)</div><div class="ttdef"><b>Definition</b> <a href="#l00014">autodiff.cpp:14</a></div></div>
<div class="ttc" id="aautodiff_8h_html"><div class="ttname"><a href="autodiff_8h.html">autodiff.h</a></div></div>
<div class="ttc" id="aclassmim_1_1Arr_html"><div class="ttname"><a href="classmim_1_1Arr.html">mim::Arr</a></div><div class="ttdoc">A (possibly paramterized) Array.</div><div class="ttdef"><b>Definition</b> <a href="tuple_8h_source.html#l00117">tuple.h:117</a></div></div>
<div class="ttc" id="aclassmim_1_1Axm_html_a606d1a978089ad57ff1369cb233f6338"><div class="ttname"><a href="classmim_1_1Axm.html#a606d1a978089ad57ff1369cb233f6338">mim::Axm::isa</a></div><div class="ttdeci">static auto isa(const Def *def)</div><div class="ttdef"><b>Definition</b> <a href="axm_8h_source.html#l00107">axm.h:107</a></div></div>
<div class="ttc" id="aclassmim_1_1Def_html"><div class="ttname"><a href="classmim_1_1Def.html">mim::Def</a></div><div class="ttdoc">Base class for all Defs.</div><div class="ttdef"><b>Definition</b> <a href="def_8h_source.html#l00252">def.h:252</a></div></div>
<div class="ttc" id="aclassmim_1_1Def_html_a2d85181e61754391ee525fc255cac90e"><div class="ttname"><a href="classmim_1_1Def.html#a2d85181e61754391ee525fc255cac90e">mim::Def::world</a></div><div class="ttdeci">World & world() const noexcept</div><div class="ttdef"><b>Definition</b> <a href="def_8cpp_source.html#l00444">def.cpp:444</a></div></div>
<div class="ttc" id="aclassmim_1_1Def_html_a361f116b80b8b8fd1eac9a22e34564b0"><div class="ttname"><a href="classmim_1_1Def.html#a361f116b80b8b8fd1eac9a22e34564b0">mim::Def::node_name</a></div><div class="ttdeci">std::string_view node_name() const</div><div class="ttdef"><b>Definition</b> <a href="def_8cpp_source.html#l00465">def.cpp:465</a></div></div>
<div class="ttc" id="aclassmim_1_1Idx_html_a7b4496e71deaa94835f732de364e5d76"><div class="ttname"><a href="classmim_1_1Idx.html#a7b4496e71deaa94835f732de364e5d76">mim::Idx::isa</a></div><div class="ttdeci">static const Def * isa(const Def *def)</div><div class="ttdoc">Checks if def is a Idx s and returns s or nullptr otherwise.</div><div class="ttdef"><b>Definition</b> <a href="def_8cpp_source.html#l00616">def.cpp:616</a></div></div>
<div class="ttc" id="aclassmim_1_1Pi_html"><div class="ttname"><a href="classmim_1_1Pi.html">mim::Pi</a></div><div class="ttdoc">A dependent function type.</div><div class="ttdef"><b>Definition</b> <a href="lam_8h_source.html#l00014">lam.h:14</a></div></div>
<div class="ttc" id="aclassmim_1_1Pi_html_a60c2d05d18e618930742433ce71e0a61"><div class="ttname"><a href="classmim_1_1Pi.html#a60c2d05d18e618930742433ce71e0a61">mim::Pi::isa_cn</a></div><div class="ttdeci">static const Pi * isa_cn(const Def *d)</div><div class="ttdoc">Is this a continuation - i.e. is the Pi::codom mim::Bottom?</div><div class="ttdef"><b>Definition</b> <a href="lam_8h_source.html#l00047">lam.h:47</a></div></div>
<div class="ttc" id="aclassmim_1_1Pi_html_a7941d7dac71f378682c9303de3e45e27"><div class="ttname"><a href="classmim_1_1Pi.html#a7941d7dac71f378682c9303de3e45e27">mim::Pi::dom</a></div><div class="ttdeci">const Def * dom() const</div><div class="ttdef"><b>Definition</b> <a href="lam_8h_source.html#l00035">lam.h:35</a></div></div>
<div class="ttc" id="aclassmim_1_1Pi_html_a826161c3dae157a2aa1c273f71f0a8c2"><div class="ttname"><a href="classmim_1_1Pi.html#a826161c3dae157a2aa1c273f71f0a8c2">mim::Pi::codom</a></div><div class="ttdeci">const Def * codom() const</div><div class="ttdef"><b>Definition</b> <a href="lam_8h_source.html#l00036">lam.h:36</a></div></div>
<div class="ttc" id="aclassmim_1_1Sigma_html"><div class="ttname"><a href="classmim_1_1Sigma.html">mim::Sigma</a></div><div class="ttdoc">A dependent tuple type.</div><div class="ttdef"><b>Definition</b> <a href="tuple_8h_source.html#l00020">tuple.h:20</a></div></div>
<div class="ttc" id="aclassmim_1_1Stage_html_aaf397a927e480d7c69023d39441e7a90"><div class="ttname"><a href="classmim_1_1Stage.html#aaf397a927e480d7c69023d39441e7a90">mim::Stage::hook</a></div><div class="ttdeci">static void hook(Flags2Stages &stages)</div><div class="ttdef"><b>Definition</b> <a href="pass_8h_source.html#l00057">pass.h:57</a></div></div>
<div class="ttc" id="aclassmim_1_1World_html_a41d6416de4c8ec665cb15c3ca7db77e6"><div class="ttname"><a href="classmim_1_1World.html#a41d6416de4c8ec665cb15c3ca7db77e6">mim::World::app</a></div><div class="ttdeci">const Def * app(const Def *callee, const Def *arg)</div><div class="ttdef"><b>Definition</b> <a href="world_8cpp_source.html#l00201">world.cpp:201</a></div></div>
<div class="ttc" id="aconfig_8h_html"><div class="ttname"><a href="config_8h.html">config.h</a></div></div>
<div class="ttc" id="aconfig_8h_html_acf14f602e3976ff8653bb419a1d77a7f"><div class="ttname"><a href="config_8h.html#acf14f602e3976ff8653bb419a1d77a7f">MIM_EXPORT</a></div><div class="ttdeci">#define MIM_EXPORT</div><div class="ttdef"><b>Definition</b> <a href="config_8h_source.html#l00019">config.h:19</a></div></div>
<div class="ttc" id="aeval_8h_html"><div class="ttname"><a href="eval_8h.html">eval.h</a></div></div>
<div class="ttc" id="amem_8h_html"><div class="ttname"><a href="mem_8h.html">mem.h</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html">mim::plug::autodiff</a></div><div class="ttdoc">The automatic differentiation Plugin</div><div class="ttdef"><b>Definition</b> <a href="autodiff_8h_source.html#l00006">autodiff.h:6</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a0147856a9a811ec390d08298087df30e"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a0147856a9a811ec390d08298087df30e">mim::plug::autodiff::autodiff_type_fun_pi</a></div><div class="ttdeci">const Pi * autodiff_type_fun_pi(const Pi *)</div><div class="ttdef"><b>Definition</b> <a href="#l00088">autodiff.cpp:88</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a0dc86993105c5eda1d3a217ba20ce699"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a0dc86993105c5eda1d3a217ba20ce699">mim::plug::autodiff::op_sum</a></div><div class="ttdeci">const Def * op_sum(const Def *T, Defs)</div><div class="ttdef"><b>Definition</b> <a href="#l00167">autodiff.cpp:167</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a12e6386bac07e09fa61550bfa5631b9d"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a12e6386bac07e09fa61550bfa5631b9d">mim::plug::autodiff::zero_repl</a></div><div class="ttdeci">zero_repl</div><div class="ttdef"><b>Definition</b> <a href="autodiff_2autogen_8h_source.html#l00062">autogen.h:62</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a1e3297839dced2ccc616d130b6404148"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a1e3297839dced2ccc616d130b6404148">mim::plug::autodiff::zero</a></div><div class="ttdeci">zero</div><div class="ttdef"><b>Definition</b> <a href="autodiff_2autogen_8h_source.html#l00038">autogen.h:38</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a27536fa48373a84728e55704e659a420"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a27536fa48373a84728e55704e659a420">mim::plug::autodiff::sum</a></div><div class="ttdeci">sum</div><div class="ttdef"><b>Definition</b> <a href="autodiff_2autogen_8h_source.html#l00054">autogen.h:54</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a589f0358511f85fee02a5e10db63a5b7"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a589f0358511f85fee02a5e10db63a5b7">mim::plug::autodiff::autodiff_type_fun</a></div><div class="ttdeci">const Def * autodiff_type_fun(const Def *)</div><div class="ttdef"><b>Definition</b> <a href="#l00111">autodiff.cpp:111</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a5fbb31cd7dee586d07837fc5c55eed78"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a5fbb31cd7dee586d07837fc5c55eed78">mim::plug::autodiff::zero_def</a></div><div class="ttdeci">const Def * zero_def(const Def *T)</div><div class="ttdef"><b>Definition</b> <a href="#l00138">autodiff.cpp:138</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a68aae344814c11b1359c6b945f109153"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a68aae344814c11b1359c6b945f109153">mim::plug::autodiff::tangent_type_fun</a></div><div class="ttdeci">const Def * tangent_type_fun(const Def *)</div><div class="ttdef"><b>Definition</b> <a href="#l00055">autodiff.cpp:55</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a7d78f8fc3e4b05738330a02f7f8502e9"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a7d78f8fc3e4b05738330a02f7f8502e9">mim::plug::autodiff::zero_pullback</a></div><div class="ttdeci">const Def * zero_pullback(const Def *E, const Def *A)</div><div class="ttdef"><b>Definition</b> <a href="#l00042">autodiff.cpp:42</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_a968c053d85aa0d5c782ca7bacb51e727"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#a968c053d85aa0d5c782ca7bacb51e727">mim::plug::autodiff::id_pullback</a></div><div class="ttdeci">const Def * id_pullback(const Def *)</div><div class="ttdef"><b>Definition</b> <a href="#l00030">autodiff.cpp:30</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_ae559e1df7e384d843cb9e1951c7d1d90"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#ae559e1df7e384d843cb9e1951c7d1d90">mim::plug::autodiff::register_normalizers</a></div><div class="ttdeci">void register_normalizers(Normalizers &normalizers)</div></div>
<div class="ttc" id="anamespacemim_1_1plug_1_1autodiff_html_aea750f837c2ff1b730c268bf3c88cb26"><div class="ttname"><a href="namespacemim_1_1plug_1_1autodiff.html#aea750f837c2ff1b730c268bf3c88cb26">mim::plug::autodiff::pullback_type</a></div><div class="ttdeci">const Pi * pullback_type(const Def *E, const Def *A)</div><div class="ttdoc">computes pb type E* -> A* E - type of the expression (return type for a function) A - type of the arg...</div><div class="ttdef"><b>Definition</b> <a href="#l00060">autodiff.cpp:60</a></div></div>
<div class="ttc" id="anamespacemim_1_1plug_html"><div class="ttname"><a href="namespacemim_1_1plug.html">mim::plug</a></div><div class="ttdef"><b>Definition</b> <a href="lower__for_8h_source.html#l00005">lower_for.h:5</a></div></div>
<div class="ttc" id="anamespacemim_html"><div class="ttname"><a href="namespacemim.html">mim</a></div><div class="ttdef"><b>Definition</b> <a href="ast_8h_source.html#l00014">ast.h:14</a></div></div>
<div class="ttc" id="anamespacemim_html_a00e263b7dcc231b14adcf75ff1ab1740"><div class="ttname"><a href="namespacemim.html#a00e263b7dcc231b14adcf75ff1ab1740">mim::Defs</a></div><div class="ttdeci">View< const Def * > Defs</div><div class="ttdef"><b>Definition</b> <a href="def_8h_source.html#l00077">def.h:77</a></div></div>
<div class="ttc" id="anamespacemim_html_a1433b0566b2cbdbf0c6f74baed22bb52"><div class="ttname"><a href="namespacemim.html#a1433b0566b2cbdbf0c6f74baed22bb52">mim::DefVec</a></div><div class="ttdeci">Vector< const Def * > DefVec</div><div class="ttdef"><b>Definition</b> <a href="def_8h_source.html#l00078">def.h:78</a></div></div>
<div class="ttc" id="anamespacemim_html_a73c02685bc8b4078797ffde79a9c1ac9"><div class="ttname"><a href="namespacemim.html#a73c02685bc8b4078797ffde79a9c1ac9">mim::Flags2Stages</a></div><div class="ttdeci">absl::flat_hash_map< flags_t, std::function< std::unique_ptr< Stage >(World &)> > Flags2Stages</div><div class="ttdoc">Maps an an axiom of a Stage to a function that creates one.</div><div class="ttdef"><b>Definition</b> <a href="plugin_8h_source.html#l00027">plugin.h:27</a></div></div>
<div class="ttc" id="anamespacemim_html_a77f34c28f8418e4828b4684cbc025e52"><div class="ttname"><a href="namespacemim.html#a77f34c28f8418e4828b4684cbc025e52">mim::mim_get_plugin</a></div><div class="ttdeci">mim::Plugin mim_get_plugin()</div></div>
<div class="ttc" id="anamespacemim_html_ab875464e5f495601abff7287573e1405"><div class="ttname"><a href="namespacemim.html#ab875464e5f495601abff7287573e1405">mim::Normalizers</a></div><div class="ttdeci">absl::flat_hash_map< flags_t, NormalizeFn > Normalizers</div><div class="ttdef"><b>Definition</b> <a href="plugin_8h_source.html#l00024">plugin.h:24</a></div></div>
<div class="ttc" id="aphase_8h_html"><div class="ttname"><a href="phase_8h.html">phase.h</a></div></div>
<div class="ttc" id="aphase_8h_html_a10fe6dd6766d951ff89316abd71620de"><div class="ttname"><a href="phase_8h.html#a10fe6dd6766d951ff89316abd71620de">MIM_REPL</a></div><div class="ttdeci">#define MIM_REPL(__stages, __annex,...)</div><div class="ttdef"><b>Definition</b> <a href="phase_8h_source.html#l00237">phase.h:237</a></div></div>
<div class="ttc" id="aplugin_8h_html_a2f1c22749113d1954fe381a30a0d5bb2"><div class="ttname"><a href="plugin_8h.html#a2f1c22749113d1954fe381a30a0d5bb2">MIM_VERSION</a></div><div class="ttdeci">#define MIM_VERSION</div><div class="ttdef"><b>Definition</b> <a href="plugin_8h_source.html#l00058">plugin.h:58</a></div></div>
<div class="ttc" id="astructmim_1_1Plugin_html"><div class="ttname"><a href="structmim_1_1Plugin.html">mim::Plugin</a></div><div class="ttdoc">Basic info and registration function pointer to be returned from a specific plugin.</div><div class="ttdef"><b>Definition</b> <a href="plugin_8h_source.html#l00063">plugin.h:63</a></div></div>
</div><!-- fragment --></div><!-- contents -->
</div><!-- doc-content -->
</div><!-- container -->
<!-- start footer part -->
<div id="nav-path" class="navpath"><!-- id is needed for treeview function! -->
<ul>
<li class="navelem"><a href="dir_68267d1309a1af8e8297ef4c3efbcdba.html">src</a></li><li class="navelem"><a href="dir_3f6d0e947440f9d0b42426d30577ffdc.html">mim</a></li><li class="navelem"><a href="dir_07110a8747d2517ee97007224f1d2994.html">plug</a></li><li class="navelem"><a href="dir_5846563cd8698f55b6851f31365c1d54.html">autodiff</a></li><li class="navelem"><a href="autodiff_8cpp.html">autodiff.cpp</a></li>
<li class="footer">Generated by <a href="https://www.doxygen.org/index.html"><img class="footer" src="doxygen.svg" width="104" height="31" alt="doxygen"/></a> 1.16.1 </li>
</ul>
</div>
</body>
</html>