Ticket #778: 778running.darcspatch.txt

File 778running.darcspatch.txt, 17.7 KB (added by kevan, at 2010-05-19T00:34:59Z)
Line 
1Tue May 18 17:18:48 PDT 2010  Kevan Carstensen <kevan@isnotajoke.com>
2  * Add a note about running Tahoe-LAFS on a small grid tooo running.html
3
4Tue May 18 17:21:35 PDT 2010  Kevan Carstensen <kevan@isnotajoke.com>
5  * Change tahoe and Tahoe to Tahoe-LAFS in running.html
6
7New patches:
8
9[Add a note about running Tahoe-LAFS on a small grid tooo running.html
10Kevan Carstensen <kevan@isnotajoke.com>**20100519001848
11 Ignore-this: c8f2d932433bfb2ebca7cd08239fad78
12] hunk ./docs/running.html 103
13 
14     <p>The <a href="configuration.txt">configuration.txt</a> file contains more details</p>
15 
16+    <h2>A note about small grids</h2>
17+
18+    <p>By default, Tahoe-LAFS ships with the configuration parameter
19+    <code>shares.happy</code> set to 7. If you are using Tahoe-LAFS on a
20+    grid with fewer than 7 storage nodes, this won't work well for you
21+    -- none of your uploads will succeed. To fix this, see <a
22+    href='configuration.txt'>configuration.txt</a> to learn how to set
23+    <code>shares.happy</code> to a more suitable value for your
24+    grid.</p>
25+
26     <h2>Do Stuff With It</h2>
27 
28     <p>Now you have a decentralized filesystem.  See <a
29[Change tahoe and Tahoe to Tahoe-LAFS in running.html
30Kevan Carstensen <kevan@isnotajoke.com>**20100519002135
31 Ignore-this: bf133712e455eb83e10d5d21f117a7d
32] {
33hunk ./docs/running.html 14
34   <body>
35     <h1>How To Start Tahoe-LAFS</h1>
36 
37-    <p>This is how to run a Tahoe client or a complete Tahoe grid. First you
38-    have to install the Tahoe software, as documented in <a
39-    href="install.html">install.html</a>.</p>
40+    <p>This is how to run a Tahoe-LAFS client or a complete Tahoe-LAFS
41+    grid. First you have to install the Tahoe-LAFS software, as documented in
42+    <a href="install.html">install.html</a>.</p>
43 
44     <p>The <cite>tahoe</cite> executable in the <code>bin</code> directory is
45     used to create, start, and stop nodes. Each node lives in a separate base
46hunk ./docs/running.html 24
47     read and write files within this base directory.</p>
48 
49     <p>A grid consists of a set of <em>nodes</em>, computers running
50-    the tahoe code, each of these nodes functions as in one of the
51+    the Tahoe-LAFS code, each of these nodes functions as in one of the
52     following roles:</p>
53 
54     <dl>
55hunk ./docs/running.html 72
56 
57 
58     <p>See <a href="configuration.txt">configuration.txt</a> for more
59-    details about how to configure tahoe.</p>
60+    details about how to configure Tahoe-LAFS.</p>
61 
62 
63     <h2>A note about firewalls</h2>
64hunk ./docs/running.html 78
65 
66     <p>If your node is behind a firewall or NAT device and want other
67-    clients to connect to it then you'll need to <em>open a port</em>
68-    in your firewall.  To do that you'll need to know which port tahoe
69+    clients to connect to it then you'll need to <em>open a port</em> in
70+    your firewall.  To do that you'll need to know which port Tahoe-LAFS
71     is listening on as, by default, it listens on an arbitrary port
72hunk ./docs/running.html 81
73-    number.  To tell tahoe to listen to a fixed port, open the
74+    number.  To tell Tahoe-LAFS to listen to a fixed port, open the
75     <code>~/.tahoe/tahoe.cfg</code> file in your favourite text editor
76     and changing the <code>tub.port</code> line to something like the
77     following:</p>
78hunk ./docs/running.html 88
79 
80     <pre>tub.port = 8098</pre>
81 
82-    <p>This tells tahoe to always listen on port 8098 of your
83+    <p>This tells Tahoe-LAFS to always listen on port 8098 of your
84     computer.  The next issue is that your computer may be behind a
85     NATing router and isn't directly connected to the internet but
86     goes through a router to get out.  If that's the case then you'll
87hunk ./docs/running.html 92
88-    need to set the <code>tub.location</code> option so that tahoe
89+    need to set the <code>tub.location</code> option so that Tahoe-LAFS
90     tells the introducer where you're really listening:</p>
91 
92     <pre>tub.location = myserver.mydomain.org:8098</pre>
93}
94
95Context:
96
97[docs: line-wrap README.txt
98zooko@zooko.com**20100518174240
99 Ignore-this: 670a02d360df7de51ebdcf4fae752577
100]
101[setup: new improved misc/show-tool-versions.py
102zooko@zooko.com**20100516050122
103 Ignore-this: ce9b1de1b35b07d733e6cf823b66335a
104]
105[Hush pyflakes warnings
106Kevan Carstensen <kevan@isnotajoke.com>**20100515184344
107 Ignore-this: fd602c3bba115057770715c36a87b400
108]
109[Improve code coverage of the Tahoe2PeerSelector tests.
110Kevan Carstensen <kevan@isnotajoke.com>**20100515032913
111 Ignore-this: 793151b63ffa65fdae6915db22d9924a
112]
113[Remove a comment that no longer makes sense.
114Kevan Carstensen <kevan@isnotajoke.com>**20100514203516
115 Ignore-this: 956983c7e7c7e4477215494dfce8f058
116]
117[docs: update docs/architecture.txt to more fully and correctly explain the upload procedure
118zooko@zooko.com**20100514043458
119 Ignore-this: 538b6ea256a49fed837500342092efa3
120]
121[Fix up the behavior of #778, per reviewers' comments
122Kevan Carstensen <kevan@isnotajoke.com>**20100514004917
123 Ignore-this: 9c20b60716125278b5456e8feb396bff
124 
125   - Make some important utility functions clearer and more thoroughly
126     documented.
127   - Assert in upload.servers_of_happiness that the buckets attributes
128     of PeerTrackers passed to it are mutually disjoint.
129   - Get rid of some silly non-Pythonisms that I didn't see when I first
130     wrote these patches.
131   - Make sure that should_add_server returns true when queried about a
132     shnum that it doesn't know about yet.
133   - Change Tahoe2PeerSelector.preexisting_shares to map a shareid to a set
134     of peerids, alter dependencies to deal with that.
135   - Remove upload.should_add_servers, because it is no longer necessary
136   - Move upload.shares_of_happiness and upload.shares_by_server to a utility
137     file.
138   - Change some points in Tahoe2PeerSelector.
139   - Compute servers_of_happiness using a bipartite matching algorithm that
140     we know is optimal instead of an ad-hoc greedy algorithm that isn't.
141   - Change servers_of_happiness to just take a sharemap as an argument,
142     change its callers to merge existing_shares and used_peers before
143     calling it.
144   - Change an error message in the encoder to be more appropriate for
145     servers of happiness.
146   - Clarify the wording of an error message in immutable/upload.py
147   - Refactor a happiness failure message to happinessutil.py, and make
148     immutable/upload.py and immutable/encode.py use it.
149   - Move the word "only" as far to the right as possible in failure
150     messages.
151   - Use a better definition of progress during peer selection.
152   - Do read-only peer share detection queries in parallel, not sequentially.
153   - Clean up logging semantics; print the query statistics whenever an
154     upload is unsuccessful, not just in one case.
155 
156]
157[Alter the error message when an upload fails, per some comments in #778.
158Kevan Carstensen <kevan@isnotajoke.com>**20091230210344
159 Ignore-this: ba97422b2f9737c46abeb828727beb1
160 
161 When I first implemented #778, I just altered the error messages to refer to
162 servers where they referred to shares. The resulting error messages weren't
163 very good. These are a bit better.
164]
165[Change "UploadHappinessError" to "UploadUnhappinessError"
166Kevan Carstensen <kevan@isnotajoke.com>**20091205043037
167 Ignore-this: 236b64ab19836854af4993bb5c1b221a
168]
169[Alter the error message returned when peer selection fails
170Kevan Carstensen <kevan@isnotajoke.com>**20091123002405
171 Ignore-this: b2a7dc163edcab8d9613bfd6907e5166
172 
173 The Tahoe2PeerSelector returned either NoSharesError or NotEnoughSharesError
174 for a variety of error conditions that weren't informatively described by them.
175 This patch creates a new error, UploadHappinessError, replaces uses of
176 NoSharesError and NotEnoughSharesError with it, and alters the error message
177 raised with the errors to be more in line with the new servers_of_happiness
178 behavior. See ticket #834 for more information.
179]
180[Eliminate overcounting iof servers_of_happiness in Tahoe2PeerSelector; also reorganize some things.
181Kevan Carstensen <kevan@isnotajoke.com>**20091118014542
182 Ignore-this: a6cb032cbff74f4f9d4238faebd99868
183]
184[Change stray "shares_of_happiness" to "servers_of_happiness"
185Kevan Carstensen <kevan@isnotajoke.com>**20091116212459
186 Ignore-this: 1c971ba8c3c4d2e7ba9f020577b28b73
187]
188[Alter Tahoe2PeerSelector to make sure that it recognizes existing shares on readonly servers, fixing an issue in #778
189Kevan Carstensen <kevan@isnotajoke.com>**20091116192805
190 Ignore-this: 15289f4d709e03851ed0587b286fd955
191]
192[Alter 'immutable/encode.py' and 'immutable/upload.py' to use servers_of_happiness instead of shares_of_happiness.
193Kevan Carstensen <kevan@isnotajoke.com>**20091104111222
194 Ignore-this: abb3283314820a8bbf9b5d0cbfbb57c8
195]
196[Alter the signature of set_shareholders in IEncoder to add a 'servermap' parameter, which gives IEncoders enough information to perform a sane check for servers_of_happiness.
197Kevan Carstensen <kevan@isnotajoke.com>**20091104033241
198 Ignore-this: b3a6649a8ac66431beca1026a31fed94
199]
200[Alter CiphertextDownloader to work with servers_of_happiness
201Kevan Carstensen <kevan@isnotajoke.com>**20090924041932
202 Ignore-this: e81edccf0308c2d3bedbc4cf217da197
203]
204[Revisions of the #778 tests, per reviewers' comments
205Kevan Carstensen <kevan@isnotajoke.com>**20100514012542
206 Ignore-this: 735bbc7f663dce633caeb3b66a53cf6e
207 
208 - Fix comments and confusing naming.
209 - Add tests for the new error messages suggested by David-Sarah
210   and Zooko.
211 - Alter existing tests for new error messages.
212 - Make sure that the tests continue to work with the trunk.
213 - Add a test for a mutual disjointedness assertion that I added to
214   upload.servers_of_happiness.
215 - Fix the comments to correctly reflect read-onlyness
216 - Add a test for an edge case in should_add_server
217 - Add an assertion to make sure that share redistribution works as it
218   should
219 - Alter tests to work with revised servers_of_happiness semantics
220 - Remove tests for should_add_server, since that function no longer exists.
221 - Alter tests to know about merge_peers, and to use it before calling
222   servers_of_happiness.
223 - Add tests for merge_peers.
224 - Add Zooko's puzzles to the tests.
225 - Edit encoding tests to expect the new kind of failure message.
226 - Edit tests to expect error messages with the word "only" moved as far
227   to the right as possible.
228 - Extended and cleaned up some helper functions.
229 - Changed some tests to call more appropriate helper functions.
230 - Added a test for the failing redistribution algorithm
231 - Added a test for the progress message
232 - Added a test for the upper bound on readonly peer share discovery.
233 
234]
235[Alter various unit tests to work with the new happy behavior
236Kevan Carstensen <kevan@isnotajoke.com>**20100107181325
237 Ignore-this: 132032bbf865e63a079f869b663be34a
238]
239[Replace "UploadHappinessError" with "UploadUnhappinessError" in tests.
240Kevan Carstensen <kevan@isnotajoke.com>**20091205043453
241 Ignore-this: 83f4bc50c697d21b5f4e2a4cd91862ca
242]
243[Add tests for the behavior described in #834.
244Kevan Carstensen <kevan@isnotajoke.com>**20091123012008
245 Ignore-this: d8e0aa0f3f7965ce9b5cea843c6d6f9f
246]
247[Re-work 'test_upload.py' to be more readable; add more tests for #778
248Kevan Carstensen <kevan@isnotajoke.com>**20091116192334
249 Ignore-this: 7e8565f92fe51dece5ae28daf442d659
250]
251[Test Tahoe2PeerSelector to make sure that it recognizeses existing shares on readonly servers
252Kevan Carstensen <kevan@isnotajoke.com>**20091109003735
253 Ignore-this: 12f9b4cff5752fca7ed32a6ebcff6446
254]
255[Add more tests for comment:53 in ticket #778
256Kevan Carstensen <kevan@isnotajoke.com>**20091104112849
257 Ignore-this: 3bb2edd299a944cc9586e14d5d83ec8c
258]
259[Add a test for upload.shares_by_server
260Kevan Carstensen <kevan@isnotajoke.com>**20091104111324
261 Ignore-this: f9802e82d6982a93e00f92e0b276f018
262]
263[Minor tweak to an existing test -- make the first server read-write, instead of read-only
264Kevan Carstensen <kevan@isnotajoke.com>**20091104034232
265 Ignore-this: a951a46c93f7f58dd44d93d8623b2aee
266]
267[Alter tests to use the new form of set_shareholders
268Kevan Carstensen <kevan@isnotajoke.com>**20091104033602
269 Ignore-this: 3deac11fc831618d11441317463ef830
270]
271[Refactor some behavior into a mixin, and add tests for the behavior described in #778
272"Kevan Carstensen" <kevan@isnotajoke.com>**20091030091908
273 Ignore-this: a6f9797057ca135579b249af3b2b66ac
274]
275[Alter NoNetworkGrid to allow the creation of readonly servers for testing purposes.
276Kevan Carstensen <kevan@isnotajoke.com>**20091018013013
277 Ignore-this: e12cd7c4ddeb65305c5a7e08df57c754
278]
279[Update 'docs/architecture.txt' to reflect readonly share discovery
280kevan@isnotajoke.com**20100514003852
281 Ignore-this: 7ead71b34df3b1ecfdcfd3cb2882e4f9
282]
283[Alter the wording in docs/architecture.txt to more accurately describe the servers_of_happiness behavior.
284Kevan Carstensen <kevan@isnotajoke.com>**20100428002455
285 Ignore-this: 6eff7fa756858a1c6f73728d989544cc
286]
287[Alter wording in 'interfaces.py' to be correct wrt #778
288"Kevan Carstensen" <kevan@isnotajoke.com>**20091205034005
289 Ignore-this: c9913c700ac14e7a63569458b06980e0
290]
291[Update 'docs/configuration.txt' to reflect the servers_of_happiness behavior.
292Kevan Carstensen <kevan@isnotajoke.com>**20091205033813
293 Ignore-this: 5e1cb171f8239bfb5b565d73c75ac2b8
294]
295[Clarify quickstart instructions for installing pywin32
296david-sarah@jacaranda.org**20100511180300
297 Ignore-this: d4668359673600d2acbc7cd8dd44b93c
298]
299[web: add a simple test that you can load directory.xhtml
300zooko@zooko.com**20100510063729
301 Ignore-this: e49b25fa3c67b3c7a56c8b1ae01bb463
302]
303[setup: fix typos in misc/show-tool-versions.py
304zooko@zooko.com**20100510063615
305 Ignore-this: 2181b1303a0e288e7a9ebd4c4855628
306]
307[setup: show code-coverage tool versions in show-tools-versions.py
308zooko@zooko.com**20100510062955
309 Ignore-this: 4b4c68eb3780b762c8dbbd22b39df7cf
310]
311[docs: update README, mv it to README.txt, update setup.py
312zooko@zooko.com**20100504094340
313 Ignore-this: 40e28ca36c299ea1fd12d3b91e5b421c
314]
315[Dependency on Windmill test framework is not needed yet.
316david-sarah@jacaranda.org**20100504161043
317 Ignore-this: be088712bec650d4ef24766c0026ebc8
318]
319[tests: pass z to tar so that BSD tar will know to ungzip
320zooko@zooko.com**20100504090628
321 Ignore-this: 1339e493f255e8fc0b01b70478f23a09
322]
323[setup: update comments and URLs in setup.cfg
324zooko@zooko.com**20100504061653
325 Ignore-this: f97692807c74bcab56d33100c899f829
326]
327[setup: reorder and extend the show-tool-versions script, the better to glean information about our new buildslaves
328zooko@zooko.com**20100504045643
329 Ignore-this: 836084b56b8d4ee8f1de1f4efb706d36
330]
331[CLI: Support for https url in option --node-url
332Francois Deppierraz <francois@ctrlaltdel.ch>**20100430185609
333 Ignore-this: 1717176b4d27c877e6bc67a944d9bf34
334 
335 This patch modifies the regular expression used for verifying of '--node-url'
336 parameter.  Support for accessing a Tahoe gateway over HTTPS was already
337 present, thanks to Python's urllib.
338 
339]
340[backupdb.did_create_directory: use REPLACE INTO, not INSERT INTO + ignore error
341Brian Warner <warner@lothar.com>**20100428050803
342 Ignore-this: 1fca7b8f364a21ae413be8767161e32f
343 
344 This handles the case where we upload a new tahoe directory for a
345 previously-processed local directory, possibly creating a new dircap (if the
346 metadata had changed). Now we replace the old dirhash->dircap record. The
347 previous behavior left the old record in place (with the old dircap and
348 timestamps), so we'd never stop creating new directories and never converge
349 on a null backup.
350]
351["tahoe webopen": add --info flag, to get ?t=info
352Brian Warner <warner@lothar.com>**20100424233003
353 Ignore-this: 126b0bb6db340fabacb623d295eb45fa
354 
355 Also fix some trailing whitespace.
356]
357[docs: install.html http-equiv refresh to quickstart.html
358zooko@zooko.com**20100421165708
359 Ignore-this: 52b4b619f9dde5886ae2cd7f1f3b734b
360]
361[docs: install.html -> quickstart.html
362zooko@zooko.com**20100421155757
363 Ignore-this: 6084e203909306bed93efb09d0e6181d
364 It is not called "installing" because that implies that it is going to change the configuration of your operating system. It is not called "building" because that implies that you need developer tools like a compiler. Also I added a stern warning against looking at the "InstallDetails" wiki page, which I have renamed to "AdvancedInstall".
365]
366[Fix another typo in tahoe_storagespace munin plugin
367david-sarah@jacaranda.org**20100416220935
368 Ignore-this: ad1f7aa66b554174f91dfb2b7a3ea5f3
369]
370[Add dependency on windmill >= 1.3
371david-sarah@jacaranda.org**20100416190404
372 Ignore-this: 4437a7a464e92d6c9012926b18676211
373]
374[licensing: phrase the OpenSSL-exemption in the vocabulary of copyright instead of computer technology, and replicate the exemption from the GPL to the TGPPL
375zooko@zooko.com**20100414232521
376 Ignore-this: a5494b2f582a295544c6cad3f245e91
377]
378[munin-tahoe_storagespace
379freestorm77@gmail.com**20100221203626
380 Ignore-this: 14d6d6a587afe1f8883152bf2e46b4aa
381 
382 Plugin configuration rename
383 
384]
385[setup: add licensing declaration for setuptools (noticed by the FSF compliance folks)
386zooko@zooko.com**20100309184415
387 Ignore-this: 2dfa7d812d65fec7c72ddbf0de609ccb
388]
389[setup: fix error in licensing declaration from Shawn Willden, as noted by the FSF compliance division
390zooko@zooko.com**20100309163736
391 Ignore-this: c0623d27e469799d86cabf67921a13f8
392]
393[CREDITS to Jacob Appelbaum
394zooko@zooko.com**20100304015616
395 Ignore-this: 70db493abbc23968fcc8db93f386ea54
396]
397[desert-island-build-with-proper-versions
398jacob@appelbaum.net**20100304013858]
399[docs: a few small edits to try to guide newcomers through the docs
400zooko@zooko.com**20100303231902
401 Ignore-this: a6aab44f5bf5ad97ea73e6976bc4042d
402 These edits were suggested by my watching over Jake Appelbaum's shoulder as he completely ignored/skipped/missed install.html and also as he decided that debian.txt wouldn't help him with basic installation. Then I threw in a few docs edits that have been sitting around in my sandbox asking to be committed for months.
403]
404[TAG allmydata-tahoe-1.6.1
405david-sarah@jacaranda.org**20100228062314
406 Ignore-this: eb5f03ada8ea953ee7780e7fe068539
407]
408Patch bundle hash:
4099244f88740849cdf9c673c77dfdaaf5850885c3e