Ticket #1534: fix-1534.darcs.patch

File fix-1534.darcs.patch, 66.2 KB (added by davidsarah, at 2011-09-14T14:44:53Z)

mutable/layout.py: improve confusing documentation of layout. fixes #1534

Line 
11 patch for repository davidsarah@dev.allmydata.org:/home/darcs/tahoe/trunk:
2
3Wed Sep 14 15:39:47 BST 2011  david-sarah@jacaranda.org
4  * mutable/layout.py: improve confusing documentation of layout. fixes #1534
5
6New patches:
7
8[mutable/layout.py: improve confusing documentation of layout. fixes #1534
9david-sarah@jacaranda.org**20110914143947
10 Ignore-this: c5fbd3809ee3f7fc2b46cd23dad6b1c0
11] {
12hunk ./src/allmydata/mutable/layout.py 12
13 from zope.interface import implements
14 
15 
16-# These strings describe the format of the packed structs they help process
17+# These strings describe the format of the packed structs they help process.
18 # Here's what they mean:
19 #
20 #  PREFIX:
21hunk ./src/allmydata/mutable/layout.py 17
22 #    >: Big-endian byte order; the most significant byte is first (leftmost).
23-#    B: The version information; an 8 bit version identifier. Stored as
24-#       an unsigned char. This is currently 00 00 00 00; our modifications
25-#       will turn it into 00 00 00 01.
26+#    B: The container version information; stored as an unsigned 8-bit integer.
27+#       This is currently either SDMF_VERSION or MDMF_VERSION.
28 #    Q: The sequence number; this is sort of like a revision history for
29 #       mutable files; they start at 1 and increase as they are changed after
30hunk ./src/allmydata/mutable/layout.py 21
31-#       being uploaded. Stored as an unsigned long long, which is 8 bytes in
32-#       length.
33+#       being uploaded. Stored as an unsigned 64-bit integer.
34 #  32s: The root hash of the share hash tree. We use sha-256d, so we use 32
35hunk ./src/allmydata/mutable/layout.py 23
36-#       characters = 32 bytes to store the value.
37-#  16s: The salt for the readkey. This is a 16-byte random value, stored as
38-#       16 characters.
39+#       bytes to store the value.
40+#  16s: The salt for the readkey. This is a 16-byte random value.
41 #
42 #  SIGNED_PREFIX additions, things that are covered by the signature:
43hunk ./src/allmydata/mutable/layout.py 27
44-#    B: The "k" encoding parameter. We store this as an 8-bit character,
45-#       which is convenient because our erasure coding scheme cannot
46-#       encode if you ask for more than 255 pieces.
47-#    B: The "N" encoding parameter. Stored as an 8-bit character for the
48-#       same reasons as above.
49-#    Q: The segment size of the uploaded file. This will essentially be the
50-#       length of the file in SDMF. An unsigned long long, so we can store
51-#       files of quite large size.
52-#    Q: The data length of the uploaded file. Modulo padding, this will be
53-#       the same of the data length field. Like the data length field, it is
54-#       an unsigned long long and can be quite large.
55+#    B: The "k" encoding parameter. We store this as an unsigned 8-bit
56+#       integer, since our erasure coding scheme cannot encode to more than
57+#       255 pieces.
58+#    B: The "N" encoding parameter. Stored as an unsigned 8-bit integer for
59+#       the same reason as above.
60+#    Q: The segment size of the uploaded file. This is an unsigned 64-bit
61+#       integer, to allow handling large segments and files. For SDMF the
62+#       segment size is the data length plus padding; for MDMF it can be
63+#       smaller.
64+#    Q: The data length of the uploaded file. Like the segment size field,
65+#       it is an unsigned 64-bit integer.
66 #
67 #   HEADER additions:
68hunk ./src/allmydata/mutable/layout.py 40
69-#     L: The offset of the signature of this. An unsigned long.
70-#     L: The offset of the share hash chain. An unsigned long.
71-#     L: The offset of the block hash tree. An unsigned long.
72-#     L: The offset of the share data. An unsigned long.
73-#     Q: The offset of the encrypted private key. An unsigned long long, to
74-#        account for the possibility of a lot of share data.
75-#     Q: The offset of the EOF. An unsigned long long, to account for the
76-#        possibility of a lot of share data.
77+#     L: The offset of the signature. An unsigned 32-bit integer.
78+#     L: The offset of the share hash chain. An unsigned 32-bit integer.
79+#     L: The offset of the block hash tree. An unsigned 32-bit integer.
80+#     L: The offset of the share data. An unsigned 32-bit integer.
81+#     Q: The offset of the encrypted private key. An unsigned 64-bit integer,
82+#        to account for the possibility of a lot of share data.
83+#     Q: The offset of the EOF. An unsigned 64-bit integer, to account for
84+#        the possibility of a lot of share data.
85 #
86 #  After all of these, we have the following:
87 #    - The verification key: Occupies the space between the end of the header
88hunk ./src/allmydata/mutable/layout.py 65
89 #  Given this, we may need to check to see how many bytes a reasonably sized
90 #  block hash tree will take up.
91 
92-PREFIX = ">BQ32s16s" # each version has a different prefix
93+PREFIX = ">BQ32s16s" # each version may have a different prefix
94 SIGNED_PREFIX = ">BQ32s16s BBQQ" # this is covered by the signature
95 SIGNED_PREFIX_LENGTH = struct.calcsize(SIGNED_PREFIX)
96 HEADER = ">BQ32s16s BBQQ LLLLQQ" # includes offsets
97hunk ./src/allmydata/mutable/layout.py 73
98 OFFSETS = ">LLLLQQ"
99 OFFSETS_LENGTH = struct.calcsize(OFFSETS)
100 
101-# These are still used for some tests.
102+
103+# These are still used for some tests of SDMF files.
104 def unpack_header(data):
105     o = {}
106     (version,
107}
108
109Context:
110
111[docs: insert a newline at the beginning of known_issues.rst to see if this makes it render more nicely in trac
112zooko@zooko.com**20110914064728
113 Ignore-this: aca15190fa22083c5d4114d3965f5d65
114]
115[docs: remove the coding: utf-8 declaration at the to of known_issues.rst, since the trac rendering doesn't hide it
116zooko@zooko.com**20110914055713
117 Ignore-this: 941ed32f83ead377171aa7a6bd198fcf
118]
119[docs: more cleanup of known_issues.rst -- now it passes "rst2html --verbose" without comment
120zooko@zooko.com**20110914055419
121 Ignore-this: 5505b3d76934bd97d0312cc59ed53879
122]
123[docs: more formatting improvements to known_issues.rst
124zooko@zooko.com**20110914051639
125 Ignore-this: 9ae9230ec9a38a312cbacaf370826691
126]
127[docs: reformatting of known_issues.rst
128zooko@zooko.com**20110914050240
129 Ignore-this: b8be0375079fb478be9d07500f9aaa87
130]
131[docs: fix formatting error in docs/known_issues.rst
132zooko@zooko.com**20110914045909
133 Ignore-this: f73fe74ad2b9e655aa0c6075acced15a
134]
135[merge Tahoe-LAFS v1.8.3 release announcement with trunk
136zooko@zooko.com**20110913210544
137 Ignore-this: 163f2c3ddacca387d7308e4b9332516e
138]
139[docs: release notes for Tahoe-LAFS v1.8.3
140zooko@zooko.com**20110913165826
141 Ignore-this: 84223604985b14733a956d2fbaeb4e9f
142]
143[tests: bump up the timeout in this test that fails on FreeStorm's CentOS in order to see if it is just very slow
144zooko@zooko.com**20110913024255
145 Ignore-this: 6a86d691e878cec583722faad06fb8e4
146]
147[interfaces: document that the 'fills-holes-with-zero-bytes' key should be used to detect whether a storage server has that behavior. refs #1528
148david-sarah@jacaranda.org**20110913002843
149 Ignore-this: 1a00a6029d40f6792af48c5578c1fd69
150]
151[CREDITS: more CREDITS for Kevan and David-Sarah
152zooko@zooko.com**20110912223357
153 Ignore-this: 4ea8f0d6f2918171d2f5359c25ad1ada
154]
155[merge NEWS about the mutable file bounds fixes with NEWS about work-in-progress
156zooko@zooko.com**20110913205521
157 Ignore-this: 4289a4225f848d6ae6860dd39bc92fa8
158]
159[doc: add NEWS item about fixes to potential palimpsest issues in mutable files
160zooko@zooko.com**20110912223329
161 Ignore-this: 9d63c95ddf95c7d5453c94a1ba4d406a
162 ref. #1528
163]
164[merge the NEWS about the security fix (#1528) with the work-in-progress NEWS
165zooko@zooko.com**20110913205153
166 Ignore-this: 88e88a2ad140238c62010cf7c66953fc
167]
168[doc: add NEWS entry about the issue which allows unauthorized deletion of shares
169zooko@zooko.com**20110912223246
170 Ignore-this: 77e06d09103d2ef6bb51ea3e5d6e80b0
171 ref. #1528
172]
173[doc: add entry in known_issues.rst about the issue which allows unauthorized deletion of shares
174zooko@zooko.com**20110912223135
175 Ignore-this: b26c6ea96b6c8740b93da1f602b5a4cd
176 ref. #1528
177]
178[storage: more paranoid handling of bounds and palimpsests in mutable share files
179zooko@zooko.com**20110912222655
180 Ignore-this: a20782fa423779ee851ea086901e1507
181 * storage server ignores requests to extend shares by sending a new_length
182 * storage server fills exposed holes (created by sending a write vector whose offset begins after the end of the current data) with 0 to avoid "palimpsest" exposure of previous contents
183 * storage server zeroes out lease info at the old location when moving it to a new location
184 ref. #1528
185]
186[storage: test that the storage server ignores requests to extend shares by sending a new_length, and that the storage server fills exposed holes with 0 to avoid "palimpsest" exposure of previous contents
187zooko@zooko.com**20110912222554
188 Ignore-this: 61ebd7b11250963efdf5b1734a35271
189 ref. #1528
190]
191[immutable: prevent clients from reading past the end of share data, which would allow them to learn the cancellation secret
192zooko@zooko.com**20110912222458
193 Ignore-this: da1ebd31433ea052087b75b2e3480c25
194 Declare explicitly that we prevent this problem in the server's version dict.
195 fixes #1528 (there are two patches that are each a sufficient fix to #1528 and this is one of them)
196]
197[storage: remove the storage server's "remote_cancel_lease" function
198zooko@zooko.com**20110912222331
199 Ignore-this: 1c32dee50e0981408576daffad648c50
200 We're removing this function because it is currently unused, because it is dangerous, and because the bug described in #1528 leaks the cancellation secret, which allows anyone who knows a file's storage index to abuse this function to delete shares of that file.
201 fixes #1528 (there are two patches that are each a sufficient fix to #1528 and this is one of them)
202]
203[storage: test that the storage server does *not* have a "remote_cancel_lease" function
204zooko@zooko.com**20110912222324
205 Ignore-this: 21c652009704652d35f34651f98dd403
206 We're removing this function because it is currently unused, because it is dangerous, and because the bug described in #1528 leaks the cancellation secret, which allows anyone who knows a file's storage index to abuse this function to delete shares of that file.
207 ref. #1528
208]
209[immutable: test whether the server allows clients to read past the end of share data, which would allow them to learn the cancellation secret
210zooko@zooko.com**20110912221201
211 Ignore-this: 376e47b346c713d37096531491176349
212 Also test whether the server explicitly declares that it prevents this problem.
213 ref #1528
214]
215[Retrieve._activate_enough_peers: rewrite Verify logic
216Brian Warner <warner@lothar.com>**20110909181150
217 Ignore-this: 9367c11e1eacbf025f75ce034030d717
218]
219[Retrieve: implement/test stopProducing
220Brian Warner <warner@lothar.com>**20110909181150
221 Ignore-this: 47b2c3df7dc69835e0a066ca12e3c178
222]
223[move DownloadStopped from download.common to interfaces
224Brian Warner <warner@lothar.com>**20110909181150
225 Ignore-this: 8572acd3bb16e50341dbed8eb1d90a50
226]
227[retrieve.py: remove vestigal self._validated_readers
228Brian Warner <warner@lothar.com>**20110909181150
229 Ignore-this: faab2ec14e314a53a2ffb714de626e2d
230]
231[Retrieve: rewrite flow-control: use a top-level loop() to catch all errors
232Brian Warner <warner@lothar.com>**20110909181150
233 Ignore-this: e162d2cd53b3d3144fc6bc757e2c7714
234 
235 This ought to close the potential for dropped errors and hanging downloads.
236 Verify needs to be examined, I may have broken it, although all tests pass.
237]
238[Retrieve: merge _validate_active_prefixes into _add_active_peers
239Brian Warner <warner@lothar.com>**20110909181150
240 Ignore-this: d3ead31e17e69394ae7058eeb5beaf4c
241]
242[Retrieve: remove the initial prefix-is-still-good check
243Brian Warner <warner@lothar.com>**20110909181150
244 Ignore-this: da66ee51c894eaa4e862e2dffb458acc
245 
246 This check needs to be done with each fetch from the storage server, to
247 detect when someone has changed the share (i.e. our servermap goes stale).
248 Doing it just once at the beginning of retrieve isn't enough: a write might
249 occur after the first segment but before the second, etc.
250 
251 _try_to_validate_prefix() was not removed: it will be used by the future
252 check-with-each-fetch code.
253 
254 test_mutable.Roundtrip.test_corrupt_all_seqnum_late was disabled, since it
255 fails until this check is brought back. (the corruption it applies only
256 touches the prefix, not the block data, so the check-less retrieve actually
257 tolerates it). Don't forget to re-enable it once the check is brought back.
258]
259[MDMFSlotReadProxy: remove the queue
260Brian Warner <warner@lothar.com>**20110909181150
261 Ignore-this: 96673cb8dda7a87a423de2f4897d66d2
262 
263 This is a neat trick to reduce Foolscap overhead, but the need for an
264 explicit flush() complicates the Retrieve path and makes it prone to
265 lost-progress bugs.
266 
267 Also change test_mutable.FakeStorageServer to tolerate multiple reads of the
268 same share in a row, a limitation exposed by turning off the queue.
269]
270[rearrange Retrieve: first step, shouldn't change order of execution
271Brian Warner <warner@lothar.com>**20110909181149
272 Ignore-this: e3006368bfd2802b82ea45c52409e8d6
273]
274[CLI: test_cli.py -- remove an unnecessary call in test_mkdir_mutable_type. refs #1527
275david-sarah@jacaranda.org**20110906183730
276 Ignore-this: 122e2ffbee84861c32eda766a57759cf
277]
278[CLI: improve test for 'tahoe mkdir --mutable-type='. refs #1527
279david-sarah@jacaranda.org**20110906183020
280 Ignore-this: f1d4598e6c536f0a2b15050b3bc0ef9d
281]
282[CLI: make the --mutable-type option value for 'tahoe put' and 'tahoe mkdir' case-insensitive, and change --help for these commands accordingly. fixes #1527
283david-sarah@jacaranda.org**20110905020922
284 Ignore-this: 75a6df0a2df9c467d8c010579e9a024e
285]
286[cli: make --mutable-type imply --mutable in 'tahoe put'
287Kevan Carstensen <kevan@isnotajoke.com>**20110903190920
288 Ignore-this: 23336d3c43b2a9554e40c2a11c675e93
289]
290[SFTP: add a comment about a subtle interaction between OverwriteableFileConsumer and GeneralSFTPFile, and test the case it is commenting on.
291david-sarah@jacaranda.org**20110903222304
292 Ignore-this: 980c61d4dd0119337f1463a69aeebaf0
293]
294[improve the storage/mutable.py asserts even more
295warner@lothar.com**20110901160543
296 Ignore-this: 5b2b13c49bc4034f96e6e3aaaa9a9946
297]
298[storage/mutable.py: special characters in struct.foo arguments indicate standard as opposed to native sizes, we should be using these characters in these asserts
299wilcoxjg@gmail.com**20110901084144
300 Ignore-this: 28ace2b2678642e4d7269ddab8c67f30
301]
302[test_mutable.Version: consolidate some tests, reduce runtime from 19s to 15s
303warner@lothar.com**20110831050451
304 Ignore-this: 64815284d9e536f8f3798b5f44cf580c
305]
306[mutable/retrieve: handle the case where self._read_length is 0.
307Kevan Carstensen <kevan@isnotajoke.com>**20110830210141
308 Ignore-this: fceafbe485851ca53f2774e5a4fd8d30
309 
310 Note that the downloader will still fetch a segment for a zero-length
311 read, which is wasteful. Fixing that isn't specifically required to fix
312 #1512, but it should probably be fixed before 1.9.
313]
314[NEWS: added summary of all changes since 1.8.2. Needs editing.
315Brian Warner <warner@lothar.com>**20110830163205
316 Ignore-this: 273899b37a899fc6919b74572454b8b2
317]
318[test_mutable.Update: only upload the files needed for each test. refs #1500
319Brian Warner <warner@lothar.com>**20110829072717
320 Ignore-this: 4d2ab4c7523af9054af7ecca9c3d9dc7
321 
322 This first step shaves 15% off the runtime: from 139s to 119s on my laptop.
323 It also fixes a couple of places where a Deferred was being dropped, which
324 would cause two tests to run in parallel and also confuse error reporting.
325]
326[Let Uploader retain History instead of passing it into upload(). Fixes #1079.
327Brian Warner <warner@lothar.com>**20110829063246
328 Ignore-this: 3902c58ec12bd4b2d876806248e19f17
329 
330 This consistently records all immutable uploads in the Recent Uploads And
331 Downloads page, regardless of code path. Previously, certain webapi upload
332 operations (like PUT /uri/$DIRCAP/newchildname) failed to pass the History
333 object and were left out.
334]
335[Fix mutable publish/retrieve timing status displays. Fixes #1505.
336Brian Warner <warner@lothar.com>**20110828232221
337 Ignore-this: 4080ce065cf481b2180fd711c9772dd6
338 
339 publish:
340 * encrypt and encode times are cumulative, not just current-segment
341 
342 retrieve:
343 * same for decrypt and decode times
344 * update "current status" to include segment number
345 * set status to Finished/Failed when download is complete
346 * set progress to 1.0 when complete
347 
348 More improvements to consider:
349 * progress is currently 0% or 100%: should calculate how many segments are
350   involved (remembering retrieve can be less than the whole file) and set it
351   to a fraction
352 * "fetch" time is fuzzy: what we want is to know how much of the delay is not
353   our own fault, but since we do decode/decrypt work while waiting for more
354   shares, it's not straightforward
355]
356[Teach 'tahoe debug catalog-shares about MDMF. Closes #1507.
357Brian Warner <warner@lothar.com>**20110828080931
358 Ignore-this: 56ef2951db1a648353d7daac6a04c7d1
359]
360[debug.py: remove some dead comments
361Brian Warner <warner@lothar.com>**20110828074556
362 Ignore-this: 40e74040dd4d14fd2f4e4baaae506b31
363]
364[hush pyflakes
365Brian Warner <warner@lothar.com>**20110828074254
366 Ignore-this: bef9d537a969fa82fe4decc4ba2acb09
367]
368[MutableFileNode.set_downloader_hints: never depend upon order of dict.values()
369Brian Warner <warner@lothar.com>**20110828074103
370 Ignore-this: caaf1aa518dbdde4d797b7f335230faa
371 
372 The old code was calculating the "extension parameters" (a list) from the
373 downloader hints (a dictionary) with hints.values(), which is not stable, and
374 would result in corrupted filecaps (with the 'k' and 'segsize' hints
375 occasionally swapped). The new code always uses [k,segsize].
376]
377[layout.py: fix MDMF share layout documentation
378Brian Warner <warner@lothar.com>**20110828073921
379 Ignore-this: 3f13366fed75b5e31b51ae895450a225
380]
381[teach 'tahoe debug dump-share' about MDMF and offsets. refs #1507
382Brian Warner <warner@lothar.com>**20110828073834
383 Ignore-this: 3a9d2ef9c47a72bf1506ba41199a1dea
384]
385[test_mutable.Version.test_debug: use splitlines() to fix buildslaves
386Brian Warner <warner@lothar.com>**20110828064728
387 Ignore-this: c7f6245426fc80b9d1ae901d5218246a
388 
389 Any slave running in a directory with spaces in the name was miscounting
390 shares, causing the test to fail.
391]
392[test_mutable.Version: exercise 'tahoe debug find-shares' on MDMF. refs #1507
393Brian Warner <warner@lothar.com>**20110828005542
394 Ignore-this: cb20bea1c28bfa50a72317d70e109672
395 
396 Also changes NoNetworkGrid to put shares in storage/shares/ .
397]
398[test_mutable.py: oops, missed a .todo
399Brian Warner <warner@lothar.com>**20110828002118
400 Ignore-this: fda09ae86481352b7a627c278d2a3940
401]
402[test_mutable: merge davidsarah's patch with my Version refactorings
403warner@lothar.com**20110827235707
404 Ignore-this: b5aaf481c90d99e33827273b5d118fd0
405]
406[test_mutable.Version: factor out some expensive uploads, save 25% runtime
407Brian Warner <warner@lothar.com>**20110827232737
408 Ignore-this: ea37383eb85ea0894b254fe4dfb45544
409]
410[SDMF: update filenode with correct k/N after Retrieve. Fixes #1510.
411Brian Warner <warner@lothar.com>**20110827225031
412 Ignore-this: b50ae6e1045818c400079f118b4ef48
413 
414 Without this, we get a regression when modifying a mutable file that was
415 created with more shares (larger N) than our current tahoe.cfg . The
416 modification attempt creates new versions of the (0,1,..,newN-1) shares, but
417 leaves the old versions of the (newN,..,oldN-1) shares alone (and throws a
418 assertion error in SDMFSlotWriteProxy.finish_publishing in the process).
419 
420 The mixed versions that result (some shares with e.g. N=10, some with N=20,
421 such that both versions are recoverable) cause problems for the Publish code,
422 even before MDMF landed. Might be related to refs #1390 and refs #1042.
423]
424[layout.py: annotate assertion to figure out 'tahoe backup' failure
425Brian Warner <warner@lothar.com>**20110827195253
426 Ignore-this: 9b92b954e3ed0d0f80154fff1ff674e5
427]
428[Add 'tahoe debug dump-cap' support for MDMF, DIR2-CHK, DIR2-MDMF. refs #1507.
429Brian Warner <warner@lothar.com>**20110827195048
430 Ignore-this: 61c6af5e33fc88e0251e697a50addb2c
431 
432 This also adds tests for all those cases, and fixes an omission in uri.py
433 that broke parsing of DIR2-MDMF-Verifier and DIR2-CHK-Verifier.
434]
435[MDMF: more writable/writeable consistentifications
436warner@lothar.com**20110827190602
437 Ignore-this: 22492a9e20c1819ddb12091062888b55
438]
439[MDMF: s/Writable/Writeable/g, for consistency with existing SDMF code
440warner@lothar.com**20110827183357
441 Ignore-this: 9dd312acedbdb2fc2f7bef0d0fb17c0b
442]
443[test_mutable.Update: increase timeout from 120s to 400s, slaves are failing
444Brian Warner <warner@lothar.com>**20110825230140
445 Ignore-this: 101b1924a30cdbda9b2e419e95ca15ec
446]
447[tests: fix check_memory test
448zooko@zooko.com**20110825201116
449 Ignore-this: 4d66299fa8cb61d2ca04b3f45344d835
450 fixes #1503
451]
452[docs/write_coordination.rst: fix formatting and add more specific warning about access via sshfs.
453david-sarah@jacaranda.org**20110831232148
454 Ignore-this: cd9c851d3eb4e0a1e088f337c291586c
455]
456[setup.cfg: remove no-longer-supported test_mac_diskimage alias. refs #1479
457david-sarah@jacaranda.org**20110826230345
458 Ignore-this: 40e908b8937322a290fb8012bfcad02a
459]
460[TAG allmydata-tahoe-1.9.0a1
461warner@lothar.com**20110825161122
462 Ignore-this: 3cbf49f00dbda58189f893c427f65605
463]
464[touch NEWS to trigger buildslaves
465warner@lothar.com**20110825161026
466 Ignore-this: 3d444737d005a9051780d15604166401
467]
468[test_mutable.Update: remove .timeout overrides, otherwise tests ERROR
469Brian Warner <warner@lothar.com>**20110825022455
470 Ignore-this: 140ea1f7207ffd68be40e112f6e3d310
471]
472[blacklist.py: add read() method too, for completeness
473warner@lothar.com**20110825021902
474 Ignore-this: c79a429f311b01732eba2a71119e84
475]
476[Additional tests for MDMF URIs and for zero-length files. refs #393
477david-sarah@jacaranda.org**20110823011532
478 Ignore-this: a7cc0c09d1d2d72413f9cd227c47a9d5
479]
480[Additional tests for zero-length partial reads and updates to mutable versions. refs #393
481david-sarah@jacaranda.org**20110822014111
482 Ignore-this: 5fc6f4d06e11910124e4a277ec8a43ea
483]
484[Implementation, tests and docs for blacklists. This version allows listing directories containing a blacklisted child. Inclusion of blacklist.py fixed. fixes #1425
485david-sarah@jacaranda.org**20110824155928
486 Ignore-this: a306f36bb6640eaf046e66dc4beeb11c
487]
488[Make the immutable/read-only constraint checking for MDMF URIs identical to that for SSK URIs. refs #393
489david-sarah@jacaranda.org**20110823012720
490 Ignore-this: e1f59d7ff2007c81dbef2aeb14abd721
491]
492[mutable/layout.py: fix unused import. refs #393
493david-sarah@jacaranda.org**20110816225043
494 Ignore-this: 7c9d6d91521ceb9a7abd14b2c60c0604
495]
496[mutable/retrieve.py: cosmetics and remove a stale comment. refs #393
497david-sarah@jacaranda.org**20110816214612
498 Ignore-this: 916e60c9dff1ef85595822e609ff34b7
499]
500[mutable/filenode.py: don't fetch more segments than necesasry to update the file
501Kevan Carstensen <kevan@isnotajoke.com>**20110813210005
502 Ignore-this: 2b0ad0533baa6f19f18851317dfc9f15
503]
504[test/test_mutable: test for incorrect div_ceil equations
505Kevan Carstensen <kevan@isnotajoke.com>**20110813183936
506 Ignore-this: 74e6061ab2ec5e706a1235611f87d5d6
507]
508[mutable/retrieve.py: use floor division to calculate segment boundaries, don't fetch more segments than necessary
509Kevan Carstensen <kevan@isnotajoke.com>**20110813183833
510 Ignore-this: 3e272249107afd3fbc1dd30c6a4f1e31
511]
512[mdmf: clean up boolean expressions, correct typos, remove self._paused, and don't unconditionally initialize block hash trees, asll as suggested by davidsarahs' review comments
513Kevan Carstensen <kevan@isnotajoke.com>**20110813183710
514 Ignore-this: cc6ad9f98b64f379151aa58b77b6c4e5
515]
516[now that tests pass with full-size keys, return test-keys to normal (522bit)
517warner@lothar.com**20110811175418
518 Ignore-this: dbce8a6699ba9a90d91cffbc8aa87900
519]
520[fix SHARE_HASH_CHAIN_SIZE computation
521warner@lothar.com**20110811175350
522 Ignore-this: 4508359d2207c8c1b7552b546697264
523]
524[More idiomatic resolution of the conflict between ticket393-MDMF-2 and trunk. refs #393
525david-sarah@jacaranda.org**20110810202942
526 Ignore-this: 7fc54a30ab0bc6ce75b7d819800c1182
527]
528[Replace the hard-coded 522-bit RSA key size used for tests with a TEST_RSA_KEY_SIZE constant defined in test/common.py (part 2). refs #393
529david-sarah@jacaranda.org**20110810202310
530 Ignore-this: 7fbd4d004279599bbcb10f7b31fb010f
531]
532[Replace the hard-coded 522-bit RSA key size used for tests with a TEST_RSA_KEY_SIZE constant defined in test/common.py (part 1). refs #393
533david-sarah@jacaranda.org**20110810202243
534 Ignore-this: c58d8130a2f383ff4421c632499b027b
535]
536[merge some minor conflicts in test code from the 393-2 branch and trunk
537zooko@zooko.com**20110810172139
538 Ignore-this: 4a16f13eeae585c7c1dbe18c67072c90
539]
540[doc: eliminate the phrase "rootcap" from doc/frontends/FTP-and-SFTP.rst
541zooko@zooko.com**20110809132601
542 Ignore-this: f7e1dd212daa65c81fb57977bce24304
543 Two different people have asked me for help, saying they couldn't figure out what a "rootcap" is. Hopefully just calling it a "cap" will make it easier for them to find out from the other docs what it is.
544]
545[test_web.py: fix a test failure dependent on whether simplejson.loads returns a unicode or str object.
546david-sarah@jacaranda.org**20110808213925
547 Ignore-this: f7b267be8be56fcabc968e3c89999490
548]
549[immutable/filenode: fix pyflakes warnings
550Kevan Carstensen <kevan@isnotajoke.com>**20110807004514
551 Ignore-this: e8d875bf8b1c5571e31b0eff42ecf64c
552]
553[test: fix assorted tests broken by MDMF changes
554Kevan Carstensen <kevan@isnotajoke.com>**20110807004459
555 Ignore-this: 9a0dc7e5c74bfe840a9fce278619a103
556]
557[uri: add MDMF and MDMF directory caps, add extension hint support
558Kevan Carstensen <kevan@isnotajoke.com>**20110807004436
559 Ignore-this: 6486b7d4dc0e849c6b1e9cdfb6318eac
560]
561[test/test_mutable: tests for MDMF
562Kevan Carstensen <kevan@isnotajoke.com>**20110807004414
563 Ignore-this: 29f9c3a806d67df0ed09c4f0d857d347
564 
565 These are their own patch because they cut across a lot of the changes
566 I've made in implementing MDMF in such a way as to make it difficult to
567 split them up into the other patches.
568]
569[webapi changes for MDMF
570Kevan Carstensen <kevan@isnotajoke.com>**20110807004348
571 Ignore-this: d6d4dac680baa4c99b05882b3828796c
572 
573     - Learn how to create MDMF files and directories through the
574       mutable-type argument.
575     - Operate with the interface changes associated with MDMF and #993.
576     - Learn how to do partial updates of mutable files.
577]
578[mutable/servermap: Rework the servermap to work with MDMF mutable files
579Kevan Carstensen <kevan@isnotajoke.com>**20110807004259
580 Ignore-this: 154b987fa0af716c41185b88ff7ee2e1
581]
582[dirnode: teach dirnode to make MDMF directories
583Kevan Carstensen <kevan@isnotajoke.com>**20110807004224
584 Ignore-this: 765ccd6a07ff752bf6057a3dab9e5abd
585]
586[Fix some test failures caused by #393 patch.
587david-sarah@jacaranda.org**20110802032810
588 Ignore-this: 7f65e5adb5c859af289cea7011216fef
589]
590[docs: amend configuration, webapi documentation to talk about MDMF
591Kevan Carstensen <kevan@isnotajoke.com>**20110802022056
592 Ignore-this: 4cab9b7e4ab79cc1efdabe2d457f27a6
593]
594[cli: teach CLI how to create MDMF mutable files
595Kevan Carstensen <kevan@isnotajoke.com>**20110802021613
596 Ignore-this: 18d0ff98e75be231eed3c53319e76936
597 
598 Specifically, 'tahoe mkdir' and 'tahoe put' now take a --mutable-type
599 argument.
600]
601[frontends/sftpd: Resolve incompatibilities between SFTP frontend and MDMF changes
602Kevan Carstensen <kevan@isnotajoke.com>**20110802021207
603 Ignore-this: 5e0f6e961048f71d4eed6d30210ffd2e
604]
605[mutable/layout: Define MDMF share format, write tools for working with MDMF share format
606Kevan Carstensen <kevan@isnotajoke.com>**20110802021120
607 Ignore-this: fa76ef4800939e19ba3cbc22a2eab4e
608 
609 The changes in layout.py are mostly concerned with the MDMF share
610 format. In particular, we define read and write proxy objects used by
611 retrieval, publishing, and other code to write and read the MDMF share
612 format. We create equivalent proxies for SDMF objects so that these
613 objects can be suitably general.
614]
615[immutable/filenode: implement unified filenode interface
616Kevan Carstensen <kevan@isnotajoke.com>**20110802020905
617 Ignore-this: d9a442fc285157f134f5d1b4607c6a48
618]
619[immutable/literal.py: Implement interface changes in literal nodes.
620Kevan Carstensen <kevan@isnotajoke.com>**20110802020814
621 Ignore-this: 4371e71a50e65ce2607c4d67d3a32171
622]
623[test/common: Alter common test code to work with MDMF.
624Kevan Carstensen <kevan@isnotajoke.com>**20110802015643
625 Ignore-this: e564403182d0030439b168dd9f8726fa
626 
627 This mostly has to do with making the test code implement the new
628 unified filenode interfaces.
629]
630[mutable: train checker and repairer to work with MDMF mutable files
631Kevan Carstensen <kevan@isnotajoke.com>**20110802015140
632 Ignore-this: 8b1928925bed63708b71ab0de8d4306f
633]
634[nodemaker: teach nodemaker about MDMF caps
635Kevan Carstensen <kevan@isnotajoke.com>**20110802014926
636 Ignore-this: 430c73121b6883b99626cfd652fc65c4
637]
638[client: teach client how to create and work with MDMF files
639Kevan Carstensen <kevan@isnotajoke.com>**20110802014811
640 Ignore-this: d72fbc4c2ca63f00d9ab9dc2919098ff
641]
642[mutable/filenode: Modify mutable filenodes for use with MDMF
643Kevan Carstensen <kevan@isnotajoke.com>**20110802014501
644 Ignore-this: 3c230bb0ebe60a94c667b0ee0c3b28e0
645 
646 In particular:
647     - Break MutableFileNode and MutableFileVersion into distinct classes.
648     - Implement the interface modifications made for MDMF.
649     - Be aware of MDMF caps.
650     - Learn how to create and work with MDMF files.
651]
652[nodemaker: teach nodemaker how to create MDMF mutable files
653Kevan Carstensen <kevan@isnotajoke.com>**20110802014258
654 Ignore-this: 2bf1fd4f8c1d1ad0e855c678347b76c2
655]
656[interfaces: change interfaces to work with MDMF
657Kevan Carstensen <kevan@isnotajoke.com>**20110802014119
658 Ignore-this: 2f441022cf888c044bc9e6dd609db139
659 
660 A lot of this work concerns #993, in that it unifies (to an extent) the
661 interfaces of mutable and immutable files.
662]
663[mutable/publish: teach the publisher how to publish MDMF mutable files
664Kevan Carstensen <kevan@isnotajoke.com>**20110802013931
665 Ignore-this: 115217ec2b289452ec774cb725da8a86
666 
667 Like the downloader, the publisher needs some substantial changes to handle multiple segment mutable files.
668]
669[mutable/retrieve: rework the mutable downloader to handle multiple-segment files
670Kevan Carstensen <kevan@isnotajoke.com>**20110802013524
671 Ignore-this: 398d11b5cb993b50e5e4fa6e7a3856dc
672 
673 The downloader needs substantial reworking to handle multiple segment
674 mutable files, which it needs to handle for MDMF.
675]
676[Fix repeated 'the' in license text.
677david-sarah@jacaranda.org**20110819204836
678 Ignore-this: b3bd4e9ec22029fe15533ad2a60003ad
679]
680[Remove Non-Profit Open Software License from the set of 'added permission' licenses. Although it actually does qualify as an Open Source license (because it allows relicensing under plain OSL), its wording is unclear and could easily be misunderstood, and it contributes to incompatible license proliferation.
681david-sarah@jacaranda.org**20110819204742
682 Ignore-this: 7373819a6b5367581356728ea62cabb1
683]
684[docs: change links that pointed to COPYING.TGPPL.html to point to COPYING.TGPPL.rst instead
685zooko@zooko.com**20110819060142
686 Ignore-this: 301652554fd7ab4bfa5aa8f8a2863a9e
687]
688[docs: formatting: reflow to fill-column 77
689zooko@zooko.com**20110819060110
690 Ignore-this: ed1317c126f07c63b944bd2fa6aa2d21
691]
692[docs: formatting: M-x whitespace-cleanup
693zooko@zooko.com**20110819060041
694 Ignore-this: 8554b16a25067094d0dc4dc71e1b3950
695]
696[licensing: add to the list of licenses that we grant the added permission for
697zooko@zooko.com**20110819054656
698 Ignore-this: eb1490416ac6b7414a27f150a8a8a047
699 Added: most of the ones listed on the FSF's "List of Free Software, GPL Incompatible Licenses", plus the Non-Profit Open Software License.
700]
701[docs: reflow the added text at the top of COPYING.GPL to fill-column 77
702zooko@zooko.com**20110819053059
703 Ignore-this: e994ed6ffbcc12656406f11cb862ce99
704]
705[docs: reformat COPYING.TGPPL.html to COPYING.TGPPL.rst
706zooko@zooko.com**20110819052753
707 Ignore-this: 34ddf623e0a6de008ba859ca9c92b2fd
708]
709[docs: reflow docs/logging.rst to fill-column 77
710zooko@zooko.com**20110819044103
711 Ignore-this: a6901f2244995f278ddf8d75d29410bf
712]
713[doc: fix formatting error in docs/logging.rst
714zooko@zooko.com**20110819043946
715 Ignore-this: fa182dbbe7f4fda15e0a8bfcf7f00051
716]
717[Cleanups for suppression of UserWarnings. refs #1435
718david-sarah@jacaranda.org**20110818040749
719 Ignore-this: 3863ef399c1c382a1365d51f000d314c
720]
721[suppress warning emitted by newer zope.interface with Nevow 0.10
722zooko@zooko.com**20110817203134
723 Ignore-this: b86d4ce0ed1c0da76d1f9eaf8d08d9c4
724 refs #1435
725]
726[doc: formatting: reflow to fill-column=77
727zooko@zooko.com**20110809132510
728 Ignore-this: 2d6d2e203d52925968b4451f36364792
729]
730[_auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435
731david-sarah@jacaranda.org**20110815025347
732 Ignore-this: 17a88c0f6573f044fbcd6b666667bd37
733]
734[allmydata/__init__.py, test_version.py: make version parsing understand '<=', with test. refs #1435
735david-sarah@jacaranda.org**20110815035153
736 Ignore-this: 8c3a75f4a2b42b56bac48b5053c5e9c2
737]
738[Makefile and setup.py: remove setup.py commands that we no longer need, and their uses in the Makefile. Delete a stale and incorrect comment about updating _version.py. Also fix some coding style checks in the Makefile to operate on all source files.
739david-sarah@jacaranda.org**20110801031952
740 Ignore-this: 80a435dee3bc6e29058d4b37ff579922
741]
742[remove misc/debian[_helpers], rely upon official packaging instead. fixes #1454
743warner@lothar.com**20110811182705
744 Ignore-this: 79673cafc7c108db49b5ab908d7b4668
745]
746[Makefile: remove targets that used misc/debian[_helpers] which no longer exist. Also change docs/debian.rst to reflect the fact that we no longer support building .debs using those targets. refs #1454
747david-sarah@jacaranda.org**20110801031857
748 Ignore-this: 347cbeff45757db630ce34d0cfb84f92
749]
750[replace tabs with spaces in the #1441 'tahoe debug' synopsis
751warner@lothar.com**20110811173704
752 Ignore-this: 513fbfb18a3dd93119ea3700118df7ee
753]
754[Correct the information printed by '/usr/bin/tahoe debug --help' on Debian/Ubuntu. fixes #1441
755david-sarah@jacaranda.org**20110724162530
756 Ignore-this: 30d4b8c20e420e9a9d1b73eba1113ae
757]
758[doc: edit the explanation of K-of-N tradeoffs
759zooko@zooko.com**20110804193409
760 Ignore-this: ab6f4e35a995c2099340b5c9c5d30f40
761]
762[doc: clean up formatting of doc/configuration.rst
763zooko@zooko.com**20110804192722
764 Ignore-this: 7a98a3a8afb7e5441ff1f534211199ba
765 reflow to 77 chars line width, M-x white-space cleanup, blank link between name and definition
766]
767[Add test for webopen. fixes #1149
768david-sarah@jacaranda.org**20110724211659
769 Ignore-this: 1e22853f7eb05e24c3141d56a513f661
770]
771[test_client.py: relax a check in test_create_drop_uploader so that it should pass on Python 2.4.x. refs #1429
772david-sarah@jacaranda.org**20110810052504
773 Ignore-this: 1380749ceaf33c30e26c50d57476616c
774]
775[test/common_util.py: correct fix to mkdir_nonascii. refs #1472
776david-sarah@jacaranda.org**20110810051906
777 Ignore-this: 93c0c33370bc47d95c26c4cce8e05290
778]
779[test/common_util.py: fix a typo. refs #1472
780david-sarah@jacaranda.org**20110810044235
781 Ignore-this: f88643d7c82cb3577686d77bbff9e2bc
782]
783[test_client.py, test_drop_upload.py: fix pyflakes warnings.
784david-sarah@jacaranda.org**20110810034505
785 Ignore-this: 1e2d71bf2f43d63cbb423d32a6f96793
786]
787[Factor out methods dealing with non-ASCII directories and filenames from test_drop_upload.py into common_util.py. refs #1429, #1472
788david-sarah@jacaranda.org**20110810031558
789 Ignore-this: 3de8f945fa7a58fc318a1184bad0fd1a
790]
791[test_client.py: add a test that the drop-uploader is initialized correctly by client.py. Also give the DropUploader service a name, which is necessary for the test. refs #1429
792david-sarah@jacaranda.org**20110810030538
793 Ignore-this: 13d511ea9bbe9da2dcffe4a91ce94eae
794]
795[drop-upload: rename 'start' method to 'startService', which is what you're supposed to use to start a Service. refs #1429
796david-sarah@jacaranda.org**20110810030345
797 Ignore-this: d1f5e5c63937ea37be37324e2f1ae99d
798]
799[test_drop_upload.py: add comment explaining why we don't use FilePath.setContent. refs #1429
800david-sarah@jacaranda.org**20110810025942
801 Ignore-this: b95358030b63cb467d1d7f1b9a9b6978
802]
803[test_drop_upload.py: fix some grammatical and spelling nits. refs #1429
804david-sarah@jacaranda.org**20110809221231
805 Ignore-this: fd331acddd9f754173f274a34fe62f03
806]
807[drop-upload: report the configured local directory being absent differently from it being a file
808zooko@zooko.com**20110809220930
809 Ignore-this: a08879100f5f20e609be3f0ffa3b25cc
810 refs #1429
811]
812[drop-upload: rename the 'upload.uri' parameter to 'upload.dircap', and a couple of cleanups to error messages. refs #1429
813zooko@zooko.com**20110809220508
814 Ignore-this: 4846368cbe331e8653bdce1f314e276b
815 I rerecorded this patch, originally by David-Sarah, to use "darcs replace" instead of editing to do the renames. This uncovered one missed rename in Client.init_drop_uploader. (Which also means that code isn't exercised by the current unit tests.)
816 refs #1429
817]
818[drop-upload test for non-existent local dir separately from test for non-directory local dir
819zooko@zooko.com**20110809220115
820 Ignore-this: cd85f345c02f5cb71b1c1527bd4ebddc
821 A candidate patch for #1429 has a bug when it is using FilePath.is_dir() to detect whether the configured local dir exists and is a directory. FilePath.is_dir() raises exception, instead of returning False, if the thing doesn't exist. This test is to make sure that DropUploader.__init__ raise different exceptions for those two cases.
822 refs #1429
823]
824[drop-upload: unit tests for the configuration options being named "cap" instead of "uri"
825zooko@zooko.com**20110809215913
826 Ignore-this: 958c78fffb3d76b3e4817647f824e7f9
827 This is a subset of a patch that David-Sarah attached to #1429. This is just the unit-tests part of that patch, and uses darcs record instead of hunks to change the names.
828 refs #1429
829]
830[src/allmydata/storage/server.py: use the filesystem of storage/shares/, rather than storage/, to calculate remaining space. fixes #1384
831david-sarah@jacaranda.org**20110719022752
832 Ignore-this: a4781043cfd453dbb66ae4f108d80bea
833]
834[test_storage.py: test that we are using the filesystem of storage/shares/, rather than storage/, to calculate remaining space, and that the HTML status output reflects the values returned by fileutil.get_disk_stats. This version works with older versions of the mock library. refs #1384
835david-sarah@jacaranda.org**20110809190722
836 Ignore-this: db447caca37a459ca49563efa58db58c
837]
838[Work around ref #1472 by having test_drop_upload delete the non-ASCII directories it creates.
839david-sarah@jacaranda.org**20110809012334
840 Ignore-this: 5881fd5db419ba8ad12e0b2a82f6c4f0
841]
842[Remove all trailing whitespace from .py files.
843david-sarah@jacaranda.org**20110809001117
844 Ignore-this: d2658b5ce44af70cc606ae4d3085b7cc
845]
846[test_drop_upload.py: fix unused imports. refs #1429
847david-sarah@jacaranda.org**20110808235422
848 Ignore-this: 834f6b946bfea699d7d8c743edd66671
849]
850[Documentation for drop-upload frontend. refs #1429
851david-sarah@jacaranda.org**20110808182146
852 Ignore-this: b33110834e586c0b784d1736c2af5779
853]
854[Drop-upload frontend, rerecorded for 1.9 beta (and correcting a minor mistake). Includes some fixes for Windows but not the Windows inotify implementation. fixes #1429
855david-sarah@jacaranda.org**20110808234049
856 Ignore-this: 67f824c7f554e9a3a85f9fd2e1123d97
857]
858[node.py: ensure that client and introducer nodes record their port number and use that port on the next restart, fixing a regression caused by #1385. fixes #1469.
859david-sarah@jacaranda.org**20110806221934
860 Ignore-this: 1aa9d340b6570320ab2f9edc89c9e0a8
861]
862[test_runner.py: fix a race condition in the test when NODE_URL_FILE is written before PORTNUM_FILE. refs #1469
863david-sarah@jacaranda.org**20110806231842
864 Ignore-this: ab01ae7cec3a073e29eec473e64052a0
865]
866[test_runner.py: cleanups of HOTLINE_FILE writing and removal.
867david-sarah@jacaranda.org**20110806231652
868 Ignore-this: 25f5c5d6f5d8faebb26a4ce80110a335
869]
870[test_runner.py: remove an unused constant.
871david-sarah@jacaranda.org**20110806221416
872 Ignore-this: eade2695cbabbea9cafeaa8debe410bb
873]
874[node.py: fix the error path for a missing config option so that it works for a Unicode base directory.
875david-sarah@jacaranda.org**20110806221007
876 Ignore-this: 4eb9cc04b2ce05182a274a0d69dafaf3
877]
878[test_runner.py: test that client and introducer nodes record their port number and use that port on the next restart. This tests for a regression caused by ref #1385.
879david-sarah@jacaranda.org**20110806220635
880 Ignore-this: 40a0c040b142dbddd47e69b3c3712f5
881]
882[test_runner.py: fix a bug in CreateNode.do_create introduced in changeset [5114] when the tahoe.cfg file has been written with CRLF line endings. refs #1385
883david-sarah@jacaranda.org**20110804003032
884 Ignore-this: 7b7afdcf99da6671afac2d42828883eb
885]
886[test_client.py: repair Basic.test_error_on_old_config_files. refs #1385
887david-sarah@jacaranda.org**20110803235036
888 Ignore-this: 31e2a9c3febe55948de7e144353663e
889]
890[test_checker.py: increase timeout for TooParallel.test_immutable again. The ARM buildslave took 38 seconds, so 40 seconds is too close to the edge; make it 80.
891david-sarah@jacaranda.org**20110803214042
892 Ignore-this: 2d8026a6b25534e01738f78d6c7495cb
893]
894[test_runner.py: fix RunNode.test_introducer to not rely on the mtime of introducer.furl to detect when the node has restarted. Instead we detect when node.url has been written. refs #1385
895david-sarah@jacaranda.org**20110803180917
896 Ignore-this: 11ddc43b107beca42cb78af88c5c394c
897]
898[Further improve error message about old config files. refs #1385
899david-sarah@jacaranda.org**20110803174546
900 Ignore-this: 9d6cc3c288d9863dce58faafb3855917
901]
902[Slightly improve error message about old config files (avoid unnecessary Unicode escaping). refs #1385
903david-sarah@jacaranda.org**20110803163848
904 Ignore-this: a3e3930fba7ccf90b8db3d2ed5829df4
905]
906[test_checker.py: increase timeout for TooParallel.test_immutable (was consistently failing on ARM buildslave).
907david-sarah@jacaranda.org**20110803163213
908 Ignore-this: d0efceaf12628e8791862b80c85b5d56
909]
910[Fix the bug that prevents an introducer from starting when introducer.furl already exists. Also remove some dead code that used to read old config files, and rename 'warn_about_old_config_files' to reflect that it's not a warning. refs #1385
911david-sarah@jacaranda.org**20110803013212
912 Ignore-this: 2d6cd14bd06a7493b26f2027aff78f4d
913]
914[test_runner.py: modify RunNode.test_introducer to test that starting an introducer works when the introducer.furl file already exists. refs #1385
915david-sarah@jacaranda.org**20110803012704
916 Ignore-this: 8cf7f27ac4bfbb5ad8ca4a974106d437
917]
918[verifier: correct a bug introduced in changeset [5106] that caused us to only verify the first block of a file. refs #1395
919david-sarah@jacaranda.org**20110802172437
920 Ignore-this: 87fb77854a839ff217dce73544775b11
921]
922[test_repairer: add a deterministic test of share data corruption that always flips the bits of the last byte of the share data. refs #1395
923david-sarah@jacaranda.org**20110802175841
924 Ignore-this: 72f54603785007e88220c8d979e08be7
925]
926[verifier: serialize the fetching of blocks within a share so that we don't use too much RAM
927zooko@zooko.com**20110802063703
928 Ignore-this: debd9bac07dcbb6803f835a9e2eabaa1
929 
930 Shares are still verified in parallel, but within a share, don't request a
931 block until the previous block has been verified and the memory we used to hold
932 it has been freed up.
933 
934 Patch originally due to Brian. This version has a mockery-patchery-style test
935 which is "low tech" (it implements the patching inline in the test code instead
936 of using an extension of the mock.patch() function from the mock library) and
937 which unpatches in case of exception.
938 
939 fixes #1395
940]
941[add docs about timing-channel attacks
942Brian Warner <warner@lothar.com>**20110802044541
943 Ignore-this: 73114d5f5ed9ce252597b707dba3a194
944]
945['test-coverage' now needs PYTHONPATH=. to find TOP/twisted/plugins/
946Brian Warner <warner@lothar.com>**20110802041952
947 Ignore-this: d40f1f4cb426ea1c362fc961baedde2
948]
949[remove nodeid from WriteBucketProxy classes and customers
950warner@lothar.com**20110801224317
951 Ignore-this: e55334bb0095de11711eeb3af827e8e8
952 refs #1363
953]
954[remove get_serverid() from ReadBucketProxy and customers, including Checker
955warner@lothar.com**20110801224307
956 Ignore-this: 837aba457bc853e4fd413ab1a94519cb
957 and debug.py dump-share commands
958 refs #1363
959]
960[reject old-style (pre-Tahoe-LAFS-v1.3) configuration files
961zooko@zooko.com**20110801232423
962 Ignore-this: b58218fcc064cc75ad8f05ed0c38902b
963 Check for the existence of any of them and if any are found raise exception which will abort the startup of the node.
964 This is a backwards-incompatible change for anyone who is still using old-style configuration files.
965 fixes #1385
966]
967[whitespace-cleanup
968zooko@zooko.com**20110725015546
969 Ignore-this: 442970d0545183b97adc7bd66657876c
970]
971[tests: use fileutil.write() instead of open() to ensure timely close even without CPython-style reference counting
972zooko@zooko.com**20110331145427
973 Ignore-this: 75aae4ab8e5fa0ad698f998aaa1888ce
974 Some of these already had an explicit close() but I went ahead and replaced them with fileutil.write() as well for the sake of uniformity.
975]
976[Address Kevan's comment in #776 about Options classes missed when adding 'self.command_name'. refs #776, #1359
977david-sarah@jacaranda.org**20110801221317
978 Ignore-this: 8881d42cf7e6a1d15468291b0cb8fab9
979]
980[docs/frontends/webapi.rst: change some more instances of 'delete' or 'remove' to 'unlink', change some section titles, and use two blank lines between all sections. refs #776, #1104
981david-sarah@jacaranda.org**20110801220919
982 Ignore-this: 572327591137bb05c24c44812d4b163f
983]
984[cleanup: implement rm as a synonym for unlink rather than vice-versa. refs #776
985david-sarah@jacaranda.org**20110801220108
986 Ignore-this: 598dcbed870f4f6bb9df62de9111b343
987]
988[docs/webapi.rst: address Kevan's comments about use of 'delete' on ref #1104
989david-sarah@jacaranda.org**20110801205356
990 Ignore-this: 4fbf03864934753c951ddeff64392491
991]
992[docs: some changes of 'delete' or 'rm' to 'unlink'. refs #1104
993david-sarah@jacaranda.org**20110713002722
994 Ignore-this: 304d2a330d5e6e77d5f1feed7814b21c
995]
996[WUI: change the label of the button to unlink a file from 'del' to 'unlink'. Also change some internal names to 'unlink', and allow 't=unlink' as a synonym for 't=delete' in the web-API interface. Incidentally, improve a test to check for the rename button as well as the unlink button. fixes #1104
997david-sarah@jacaranda.org**20110713001218
998 Ignore-this: 3eef6b3f81b94a9c0020a38eb20aa069
999]
1000[src/allmydata/web/filenode.py: delete a stale comment that was made incorrect by changeset [3133].
1001david-sarah@jacaranda.org**20110801203009
1002 Ignore-this: b3912e95a874647027efdc97822dd10e
1003]
1004[fix typo introduced during rebasing of 'remove get_serverid from
1005Brian Warner <warner@lothar.com>**20110801200341
1006 Ignore-this: 4235b0f585c0533892193941dbbd89a8
1007 DownloadStatus.add_dyhb_request and customers' patch, to fix test failure.
1008]
1009[remove get_serverid from DownloadStatus.add_dyhb_request and customers
1010zooko@zooko.com**20110801185401
1011 Ignore-this: db188c18566d2d0ab39a80c9dc8f6be6
1012 This patch is a rebase of a patch originally written by Brian. I didn't change any of the intent of Brian's patch, just ported it to current trunk.
1013 refs #1363
1014]
1015[remove get_serverid from DownloadStatus.add_block_request and customers
1016zooko@zooko.com**20110801185344
1017 Ignore-this: 8bfa8201d6147f69b0fbe31beea9c1e
1018 This is a rebase of a patch Brian originally wrote. I haven't changed the intent of that patch, just ported it to trunk.
1019 refs #1363
1020]
1021[apply zooko's advice: storage_client get_known_servers() returns a frozenset, caller sorts
1022warner@lothar.com**20110801174452
1023 Ignore-this: 2aa13ea6cbed4e9084bd604bf8633692
1024 refs #1363
1025]
1026[test_immutable.Test: rewrite to use NoNetworkGrid, now takes 2.7s not 97s
1027warner@lothar.com**20110801174444
1028 Ignore-this: 54f30b5d7461d2b3514e2a0172f3a98c
1029 remove now-unused ShareManglingMixin
1030 refs #1363
1031]
1032[DownloadStatus.add_known_share wants to be used by Finder, web.status
1033warner@lothar.com**20110801174436
1034 Ignore-this: 1433bcd73099a579abe449f697f35f9
1035 refs #1363
1036]
1037[replace IServer.name() with get_name(), and get_longname()
1038warner@lothar.com**20110801174428
1039 Ignore-this: e5a6f7f6687fd7732ddf41cfdd7c491b
1040 
1041 This patch was originally written by Brian, but was re-recorded by Zooko to use
1042 darcs replace instead of hunks for any file in which it would result in fewer
1043 total hunks.
1044 refs #1363
1045]
1046[upload.py: apply David-Sarah's advice rename (un)contacted(2) trackers to first_pass/second_pass/next_pass
1047zooko@zooko.com**20110801174143
1048 Ignore-this: e36e1420bba0620a0107bd90032a5198
1049 This patch was written by Brian but was re-recorded by Zooko (with David-Sarah looking on) to use darcs replace instead of editing to rename the three variables to their new names.
1050 refs #1363
1051]
1052[Coalesce multiple Share.loop() calls, make downloads faster. Closes #1268.
1053Brian Warner <warner@lothar.com>**20110801151834
1054 Ignore-this: 48530fce36c01c0ff708f61c2de7e67a
1055]
1056[src/allmydata/_auto_deps.py: 'i686' is another way of spelling x86.
1057david-sarah@jacaranda.org**20110801034035
1058 Ignore-this: 6971e0621db2fba794d86395b4d51038
1059]
1060[tahoe_rm.py: better error message when there is no path. refs #1292
1061david-sarah@jacaranda.org**20110122064212
1062 Ignore-this: ff3bb2c9f376250e5fd77eb009e09018
1063]
1064[test_cli.py: Test for error message when 'tahoe rm' is invoked without a path. refs #1292
1065david-sarah@jacaranda.org**20110104105108
1066 Ignore-this: 29ec2f2e0251e446db96db002ad5dd7d
1067]
1068[src/allmydata/__init__.py: suppress a spurious warning from 'bin/tahoe --version[-and-path]' about twisted-web and twisted-core packages.
1069david-sarah@jacaranda.org**20110801005209
1070 Ignore-this: 50e7cd53cca57b1870d9df0361c7c709
1071]
1072[test_cli.py: use to_str on fields loaded using simplejson.loads in new tests. refs #1304
1073david-sarah@jacaranda.org**20110730032521
1074 Ignore-this: d1d6dfaefd1b4e733181bf127c79c00b
1075]
1076[cli: make 'tahoe cp' overwrite mutable files in-place
1077Kevan Carstensen <kevan@isnotajoke.com>**20110729202039
1078 Ignore-this: b2ad21a19439722f05c49bfd35b01855
1079]
1080[SFTP: write an error message to standard error for unrecognized shell commands. Change the existing message for shell sessions to be written to standard error, and refactor some duplicated code. Also change the lines of the error messages to end in CRLF, and take into account Kevan's review comments. fixes #1442, #1446
1081david-sarah@jacaranda.org**20110729233102
1082 Ignore-this: d2f2bb4664f25007d1602bf7333e2cdd
1083]
1084[src/allmydata/scripts/cli.py: fix pyflakes warning.
1085david-sarah@jacaranda.org**20110728021402
1086 Ignore-this: 94050140ddb99865295973f49927c509
1087]
1088[Fix the help synopses of CLI commands to include [options] in the right place. fixes #1359, fixes #636
1089david-sarah@jacaranda.org**20110724225440
1090 Ignore-this: 2a8e488a5f63dabfa9db9efd83768a5
1091]
1092[encodingutil: argv and output encodings are always the same on all platforms. Lose the unnecessary generality of them being different. fixes #1120
1093david-sarah@jacaranda.org**20110629185356
1094 Ignore-this: 5ebacbe6903dfa83ffd3ff8436a97787
1095]
1096[docs/man/tahoe.1: add man page. fixes #1420
1097david-sarah@jacaranda.org**20110724171728
1098 Ignore-this: fc7601ec7f25494288d6141d0ae0004c
1099]
1100[Update the dependency on zope.interface to fix an incompatiblity between Nevow and zope.interface 3.6.4. fixes #1435
1101david-sarah@jacaranda.org**20110721234941
1102 Ignore-this: 2ff3fcfc030fca1a4d4c7f1fed0f2aa9
1103]
1104[frontends/ftpd.py: remove the check for IWriteFile.close since we're now guaranteed to be using Twisted >= 10.1 which has it.
1105david-sarah@jacaranda.org**20110722000320
1106 Ignore-this: 55cd558b791526113db3f83c00ec328a
1107]
1108[Update the dependency on Twisted to >= 10.1. This allows us to simplify some documentation: it's no longer necessary to install pywin32 on Windows, or apply a patch to Twisted in order to use the FTP frontend. fixes #1274, #1438. refs #1429
1109david-sarah@jacaranda.org**20110721233658
1110 Ignore-this: 81b41745477163c9b39c0b59db91cc62
1111]
1112[misc/build_helpers/run_trial.py: undo change to block pywin32 (it didn't work because run_trial.py is no longer used). refs #1334
1113david-sarah@jacaranda.org**20110722035402
1114 Ignore-this: 5d03f544c4154f088e26c7107494bf39
1115]
1116[misc/build_helpers/run_trial.py: ensure that pywin32 is not on the sys.path when running the test suite. Includes some temporary debugging printouts that will be removed. refs #1334
1117david-sarah@jacaranda.org**20110722024907
1118 Ignore-this: 5141a9f83a4085ed4ca21f0bbb20bb9c
1119]
1120[docs/running.rst: use 'tahoe run ~/.tahoe' instead of 'tahoe run' (the default is the current directory, unlike 'tahoe start').
1121david-sarah@jacaranda.org**20110718005949
1122 Ignore-this: 81837fbce073e93d88a3e7ae3122458c
1123]
1124[docs/running.rst: say to put the introducer.furl in tahoe.cfg.
1125david-sarah@jacaranda.org**20110717194315
1126 Ignore-this: 954cc4c08e413e8c62685d58ff3e11f3
1127]
1128[README.txt: say that quickstart.rst is in the docs directory.
1129david-sarah@jacaranda.org**20110717192400
1130 Ignore-this: bc6d35a85c496b77dbef7570677ea42a
1131]
1132[setup: remove the dependency on foolscap's "secure_connections" extra, add a dependency on pyOpenSSL
1133zooko@zooko.com**20110717114226
1134 Ignore-this: df222120d41447ce4102616921626c82
1135 fixes #1383
1136]
1137[test_sftp.py cleanup: remove a redundant definition of failUnlessReallyEqual.
1138david-sarah@jacaranda.org**20110716181813
1139 Ignore-this: 50113380b368c573f07ac6fe2eb1e97f
1140]
1141[docs: add missing link in NEWS.rst
1142zooko@zooko.com**20110712153307
1143 Ignore-this: be7b7eb81c03700b739daa1027d72b35
1144]
1145[contrib: remove the contributed fuse modules and the entire contrib/ directory, which is now empty
1146zooko@zooko.com**20110712153229
1147 Ignore-this: 723c4f9e2211027c79d711715d972c5
1148 Also remove a couple of vestigial references to figleaf, which is long gone.
1149 fixes #1409 (remove contrib/fuse)
1150]
1151[add Protovis.js-based download-status timeline visualization
1152Brian Warner <warner@lothar.com>**20110629222606
1153 Ignore-this: 477ccef5c51b30e246f5b6e04ab4a127
1154 
1155 provide status overlap info on the webapi t=json output, add decode/decrypt
1156 rate tooltips, add zoomin/zoomout buttons
1157]
1158[add more download-status data, fix tests
1159Brian Warner <warner@lothar.com>**20110629222555
1160 Ignore-this: e9e0b7e0163f1e95858aa646b9b17b8c
1161]
1162[prepare for viz: improve DownloadStatus events
1163Brian Warner <warner@lothar.com>**20110629222542
1164 Ignore-this: 16d0bde6b734bb501aa6f1174b2b57be
1165 
1166 consolidate IDownloadStatusHandlingConsumer stuff into DownloadNode
1167]
1168[docs: fix error in crypto specification that was noticed by Taylor R Campbell <campbell+tahoe@mumble.net>
1169zooko@zooko.com**20110629185711
1170 Ignore-this: b921ed60c1c8ba3c390737fbcbe47a67
1171]
1172[setup.py: don't make bin/tahoe.pyscript executable. fixes #1347
1173david-sarah@jacaranda.org**20110130235809
1174 Ignore-this: 3454c8b5d9c2c77ace03de3ef2d9398a
1175]
1176[Makefile: remove targets relating to 'setup.py check_auto_deps' which no longer exists. fixes #1345
1177david-sarah@jacaranda.org**20110626054124
1178 Ignore-this: abb864427a1b91bd10d5132b4589fd90
1179]
1180[Makefile: add 'make check' as an alias for 'make test'. Also remove an unnecessary dependency of 'test' on 'build' and 'src/allmydata/_version.py'. fixes #1344
1181david-sarah@jacaranda.org**20110623205528
1182 Ignore-this: c63e23146c39195de52fb17c7c49b2da
1183]
1184[Rename test_package_initialization.py to (much shorter) test_import.py .
1185Brian Warner <warner@lothar.com>**20110611190234
1186 Ignore-this: 3eb3dbac73600eeff5cfa6b65d65822
1187 
1188 The former name was making my 'ls' listings hard to read, by forcing them
1189 down to just two columns.
1190]
1191[tests: fix tests to accomodate [20110611153758-92b7f-0ba5e4726fb6318dac28fb762a6512a003f4c430]
1192zooko@zooko.com**20110611163741
1193 Ignore-this: 64073a5f39e7937e8e5e1314c1a302d1
1194 Apparently none of the two authors (stercor, terrell), three reviewers (warner, davidsarah, terrell), or one committer (me) actually ran the tests. This is presumably due to #20.
1195 fixes #1412
1196]
1197[wui: right-align the size column in the WUI
1198zooko@zooko.com**20110611153758
1199 Ignore-this: 492bdaf4373c96f59f90581c7daf7cd7
1200 Thanks to Ted "stercor" Rolle Jr. and Terrell Russell.
1201 fixes #1412
1202]
1203[docs: three minor fixes
1204zooko@zooko.com**20110610121656
1205 Ignore-this: fec96579eb95aceb2ad5fc01a814c8a2
1206 CREDITS for arc for stats tweak
1207 fix link to .zip file in quickstart.rst (thanks to ChosenOne for noticing)
1208 English usage tweak
1209]
1210[docs/running.rst: fix stray HTML (not .rst) link noticed by ChosenOne.
1211david-sarah@jacaranda.org**20110609223719
1212 Ignore-this: fc50ac9c94792dcac6f1067df8ac0d4a
1213]
1214[server.py:  get_latencies now reports percentiles _only_ if there are sufficient observations for the interpretation of the percentile to be unambiguous.
1215wilcoxjg@gmail.com**20110527120135
1216 Ignore-this: 2e7029764bffc60e26f471d7c2b6611e
1217 interfaces.py:  modified the return type of RIStatsProvider.get_stats to allow for None as a return value
1218 NEWS.rst, stats.py: documentation of change to get_latencies
1219 stats.rst: now documents percentile modification in get_latencies
1220 test_storage.py:  test_latencies now expects None in output categories that contain too few samples for the associated percentile to be unambiguously reported.
1221 fixes #1392
1222]
1223[docs: revert link in relnotes.txt from NEWS.rst to NEWS, since the former did not exist at revision 5000.
1224david-sarah@jacaranda.org**20110517011214
1225 Ignore-this: 6a5be6e70241e3ec0575641f64343df7
1226]
1227[docs: convert NEWS to NEWS.rst and change all references to it.
1228david-sarah@jacaranda.org**20110517010255
1229 Ignore-this: a820b93ea10577c77e9c8206dbfe770d
1230]
1231[docs: remove out-of-date docs/testgrid/introducer.furl and containing directory. fixes #1404
1232david-sarah@jacaranda.org**20110512140559
1233 Ignore-this: 784548fc5367fac5450df1c46890876d
1234]
1235[scripts/common.py: don't assume that the default alias is always 'tahoe' (it is, but the API of get_alias doesn't say so). refs #1342
1236david-sarah@jacaranda.org**20110130164923
1237 Ignore-this: a271e77ce81d84bb4c43645b891d92eb
1238]
1239[setup: don't catch all Exception from check_requirement(), but only PackagingError and ImportError
1240zooko@zooko.com**20110128142006
1241 Ignore-this: 57d4bc9298b711e4bc9dc832c75295de
1242 I noticed this because I had accidentally inserted a bug which caused AssertionError to be raised from check_requirement().
1243]
1244[M-x whitespace-cleanup
1245zooko@zooko.com**20110510193653
1246 Ignore-this: dea02f831298c0f65ad096960e7df5c7
1247]
1248[docs: fix typo in running.rst, thanks to arch_o_median
1249zooko@zooko.com**20110510193633
1250 Ignore-this: ca06de166a46abbc61140513918e79e8
1251]
1252[relnotes.txt: don't claim to work on Cygwin (which has been untested for some time). refs #1342
1253david-sarah@jacaranda.org**20110204204902
1254 Ignore-this: 85ef118a48453d93fa4cddc32d65b25b
1255]
1256[relnotes.txt: forseeable -> foreseeable. refs #1342
1257david-sarah@jacaranda.org**20110204204116
1258 Ignore-this: 746debc4d82f4031ebf75ab4031b3a9
1259]
1260[replace remaining .html docs with .rst docs
1261zooko@zooko.com**20110510191650
1262 Ignore-this: d557d960a986d4ac8216d1677d236399
1263 Remove install.html (long since deprecated).
1264 Also replace some obsolete references to install.html with references to quickstart.rst.
1265 Fix some broken internal references within docs/historical/historical_known_issues.txt.
1266 Thanks to Ravi Pinjala and Patrick McDonald.
1267 refs #1227
1268]
1269[docs: FTP-and-SFTP.rst: fix a minor error and update the information about which version of Twisted fixes #1297
1270zooko@zooko.com**20110428055232
1271 Ignore-this: b63cfb4ebdbe32fb3b5f885255db4d39
1272]
1273[munin tahoe_files plugin: fix incorrect file count
1274francois@ctrlaltdel.ch**20110428055312
1275 Ignore-this: 334ba49a0bbd93b4a7b06a25697aba34
1276 fixes #1391
1277]
1278[corrected "k must never be smaller than N" to "k must never be greater than N"
1279secorp@allmydata.org**20110425010308
1280 Ignore-this: 233129505d6c70860087f22541805eac
1281]
1282[Fix a test failure in test_package_initialization on Python 2.4.x due to exceptions being stringified differently than in later versions of Python. refs #1389
1283david-sarah@jacaranda.org**20110411190738
1284 Ignore-this: 7847d26bc117c328c679f08a7baee519
1285]
1286[tests: add test for including the ImportError message and traceback entry in the summary of errors from importing dependencies. refs #1389
1287david-sarah@jacaranda.org**20110410155844
1288 Ignore-this: fbecdbeb0d06a0f875fe8d4030aabafa
1289]
1290[allmydata/__init__.py: preserve the message and last traceback entry (file, line number, function, and source line) of ImportErrors in the package versions string. fixes #1389
1291david-sarah@jacaranda.org**20110410155705
1292 Ignore-this: 2f87b8b327906cf8bfca9440a0904900
1293]
1294[remove unused variable detected by pyflakes
1295zooko@zooko.com**20110407172231
1296 Ignore-this: 7344652d5e0720af822070d91f03daf9
1297]
1298[allmydata/__init__.py: Nicer reporting of unparseable version numbers in dependencies. fixes #1388
1299david-sarah@jacaranda.org**20110401202750
1300 Ignore-this: 9c6bd599259d2405e1caadbb3e0d8c7f
1301]
1302[update FTP-and-SFTP.rst: the necessary patch is included in Twisted-10.1
1303Brian Warner <warner@lothar.com>**20110325232511
1304 Ignore-this: d5307faa6900f143193bfbe14e0f01a
1305]
1306[control.py: remove all uses of s.get_serverid()
1307warner@lothar.com**20110227011203
1308 Ignore-this: f80a787953bd7fa3d40e828bde00e855
1309]
1310[web: remove some uses of s.get_serverid(), not all
1311warner@lothar.com**20110227011159
1312 Ignore-this: a9347d9cf6436537a47edc6efde9f8be
1313]
1314[immutable/downloader/fetcher.py: remove all get_serverid() calls
1315warner@lothar.com**20110227011156
1316 Ignore-this: fb5ef018ade1749348b546ec24f7f09a
1317]
1318[immutable/downloader/fetcher.py: fix diversity bug in server-response handling
1319warner@lothar.com**20110227011153
1320 Ignore-this: bcd62232c9159371ae8a16ff63d22c1b
1321 
1322 When blocks terminate (either COMPLETE or CORRUPT/DEAD/BADSEGNUM), the
1323 _shares_from_server dict was being popped incorrectly (using shnum as the
1324 index instead of serverid). I'm still thinking through the consequences of
1325 this bug. It was probably benign and really hard to detect. I think it would
1326 cause us to incorrectly believe that we're pulling too many shares from a
1327 server, and thus prefer a different server rather than asking for a second
1328 share from the first server. The diversity code is intended to spread out the
1329 number of shares simultaneously being requested from each server, but with
1330 this bug, it might be spreading out the total number of shares requested at
1331 all, not just simultaneously. (note that SegmentFetcher is scoped to a single
1332 segment, so the effect doesn't last very long).
1333]
1334[immutable/downloader/share.py: reduce get_serverid(), one left, update ext deps
1335warner@lothar.com**20110227011150
1336 Ignore-this: d8d56dd8e7b280792b40105e13664554
1337 
1338 test_download.py: create+check MyShare instances better, make sure they share
1339 Server objects, now that finder.py cares
1340]
1341[immutable/downloader/finder.py: reduce use of get_serverid(), one left
1342warner@lothar.com**20110227011146
1343 Ignore-this: 5785be173b491ae8a78faf5142892020
1344]
1345[immutable/offloaded.py: reduce use of get_serverid() a bit more
1346warner@lothar.com**20110227011142
1347 Ignore-this: b48acc1b2ae1b311da7f3ba4ffba38f
1348]
1349[immutable/upload.py: reduce use of get_serverid()
1350warner@lothar.com**20110227011138
1351 Ignore-this: ffdd7ff32bca890782119a6e9f1495f6
1352]
1353[immutable/checker.py: remove some uses of s.get_serverid(), not all
1354warner@lothar.com**20110227011134
1355 Ignore-this: e480a37efa9e94e8016d826c492f626e
1356]
1357[add remaining get_* methods to storage_client.Server, NoNetworkServer, and
1358warner@lothar.com**20110227011132
1359 Ignore-this: 6078279ddf42b179996a4b53bee8c421
1360 MockIServer stubs
1361]
1362[upload.py: rearrange _make_trackers a bit, no behavior changes
1363warner@lothar.com**20110227011128
1364 Ignore-this: 296d4819e2af452b107177aef6ebb40f
1365]
1366[happinessutil.py: finally rename merge_peers to merge_servers
1367warner@lothar.com**20110227011124
1368 Ignore-this: c8cd381fea1dd888899cb71e4f86de6e
1369]
1370[test_upload.py: factor out FakeServerTracker
1371warner@lothar.com**20110227011120
1372 Ignore-this: 6c182cba90e908221099472cc159325b
1373]
1374[test_upload.py: server-vs-tracker cleanup
1375warner@lothar.com**20110227011115
1376 Ignore-this: 2915133be1a3ba456e8603885437e03
1377]
1378[happinessutil.py: server-vs-tracker cleanup
1379warner@lothar.com**20110227011111
1380 Ignore-this: b856c84033562d7d718cae7cb01085a9
1381]
1382[upload.py: more tracker-vs-server cleanup
1383warner@lothar.com**20110227011107
1384 Ignore-this: bb75ed2afef55e47c085b35def2de315
1385]
1386[upload.py: fix var names to avoid confusion between 'trackers' and 'servers'
1387warner@lothar.com**20110227011103
1388 Ignore-this: 5d5e3415b7d2732d92f42413c25d205d
1389]
1390[refactor: s/peer/server/ in immutable/upload, happinessutil.py, test_upload
1391warner@lothar.com**20110227011100
1392 Ignore-this: 7ea858755cbe5896ac212a925840fe68
1393 
1394 No behavioral changes, just updating variable/method names and log messages.
1395 The effects outside these three files should be minimal: some exception
1396 messages changed (to say "server" instead of "peer"), and some internal class
1397 names were changed. A few things still use "peer" to minimize external
1398 changes, like UploadResults.timings["peer_selection"] and
1399 happinessutil.merge_peers, which can be changed later.
1400]
1401[storage_client.py: clean up test_add_server/test_add_descriptor, remove .test_servers
1402warner@lothar.com**20110227011056
1403 Ignore-this: efad933e78179d3d5fdcd6d1ef2b19cc
1404]
1405[test_client.py, upload.py:: remove KiB/MiB/etc constants, and other dead code
1406warner@lothar.com**20110227011051
1407 Ignore-this: dc83c5794c2afc4f81e592f689c0dc2d
1408]
1409[test: increase timeout on a network test because Francois's ARM machine hit that timeout
1410zooko@zooko.com**20110317165909
1411 Ignore-this: 380c345cdcbd196268ca5b65664ac85b
1412 I'm skeptical that the test was proceeding correctly but ran out of time. It seems more likely that it had gotten hung. But if we raise the timeout to an even more extravagant number then we can be even more certain that the test was never going to finish.
1413]
1414[docs/configuration.rst: add a "Frontend Configuration" section
1415Brian Warner <warner@lothar.com>**20110222014323
1416 Ignore-this: 657018aa501fe4f0efef9851628444ca
1417 
1418 this points to docs/frontends/*.rst, which were previously underlinked
1419]
1420[web/filenode.py: avoid calling req.finish() on closed HTTP connections. Closes #1366
1421"Brian Warner <warner@lothar.com>"**20110221061544
1422 Ignore-this: 799d4de19933f2309b3c0c19a63bb888
1423]
1424[Add unit tests for cross_check_pkg_resources_versus_import, and a regression test for ref #1355. This requires a little refactoring to make it testable.
1425david-sarah@jacaranda.org**20110221015817
1426 Ignore-this: 51d181698f8c20d3aca58b057e9c475a
1427]
1428[allmydata/__init__.py: .name was used in place of the correct .__name__ when printing an exception. Also, robustify string formatting by using %r instead of %s in some places. fixes #1355.
1429david-sarah@jacaranda.org**20110221020125
1430 Ignore-this: b0744ed58f161bf188e037bad077fc48
1431]
1432[Refactor StorageFarmBroker handling of servers
1433Brian Warner <warner@lothar.com>**20110221015804
1434 Ignore-this: 842144ed92f5717699b8f580eab32a51
1435 
1436 Pass around IServer instance instead of (peerid, rref) tuple. Replace
1437 "descriptor" with "server". Other replacements:
1438 
1439  get_all_servers -> get_connected_servers/get_known_servers
1440  get_servers_for_index -> get_servers_for_psi (now returns IServers)
1441 
1442 This change still needs to be pushed further down: lots of code is now
1443 getting the IServer and then distributing (peerid, rref) internally.
1444 Instead, it ought to distribute the IServer internally and delay
1445 extracting a serverid or rref until the last moment.
1446 
1447 no_network.py was updated to retain parallelism.
1448]
1449[TAG allmydata-tahoe-1.8.2
1450warner@lothar.com**20110131020101]
1451Patch bundle hash:
1452abec99244ff9bbcb49b13680e6144a7267552995