The Final Version - first look
7 February 2012 at 13:09Here are some never-before-seen photos of the first and last pages of an actual FV list, or to be more exact the only actual FV list in existence.
The loose-leaf format is not essential. Any sort of notebook, paper or electronic will do just fine.
Comments
- Congratulations! I can't wait to try the new system.7 February 2012 at 14:07 | Bogdan
- All right!! I see a running list with some dots and lines, no highlighter, no dates or symbols or tricky tags ... as clean as can be! (... or is that a dot I see in the upper right corners? No matter ...)
Glad to see you are making progress, Mark, and evidently feeling good about it. I am looking forward to more.7 February 2012 at 14:14 | Bernie - Bernie
The dot in the upper right corner is just a page number I deleted because I decided it wasn't needed.7 February 2012 at 14:20 | Mark Forster - Mark - you're hilarious. I was hoping to see SquareSpace's new slideshow format (they sent me an update yesterday), and presto... here it is!7 February 2012 at 15:39 | avrum
- Avrum:
Well, that was my main reason for making this post.7 February 2012 at 15:41 | Mark Forster - Ooo: dots! lines!!
Must...
Not...
Guess...
but...
Wait...
For...
Book...7 February 2012 at 16:21 | will - I'm also liking the clean and simple look and feel.
More power to you Mark.7 February 2012 at 18:25 | neumatist - Looking good Mark - can't wait! Hope it's ready soon!7 February 2012 at 19:40 | Alison Reeves
- Mark,
Have you put any thought into proofreaders for the book? I already bought the other 3. I'd be glad to proofread this one for just $20. If I had to pay more than that, I might as well wait and buy it when it comes out :-)7 February 2012 at 20:47 | Michael - Not sure that I'm too keen on long lists anymore and it looks a little bit like that - possibly with several items selected at once. I suppose because I have so many scheduled tasks & appointments and I like to have all my daily commitments on one page...I am however watching this space!7 February 2012 at 21:09 | leon
- Michael:
<< Have you put any thought into proofreaders for the book? >>
Sorry to disappoint you, but I typed all three of my books myself, and I don't think the publisher's proofreaders found any mistakes in any of the three. They were basically published as far as the basic text is concerned exactly as I typed them.7 February 2012 at 23:14 | Mark Forster - <<I like to have all my daily commitments on one page >>
@leon: Oh, you can, even with AF, SF, and FV systems. Just process them often enough so that they all get pushed to the last page.
(I'm not aware of the exact FV system, but I think the end-of-list entry point hasn't changed from previous systems. Confirmed by the photographs.)8 February 2012 at 7:01 | Laurent - << Must... Not... Guess... but... Wait... For... Book... >>
@will : As you wish...
Dots = next-pass markup ?
Lines = making not yet processed tasks stand out ?8 February 2012 at 7:04 | Laurent - <<Sorry to disappoint you, but I typed all three of my books myself, and I don't think the publisher's proofreaders found any mistakes in any of the three. They were basically published as far as the basic text is concerned exactly as I typed them.>>
Wow Mark, this is impressive. I do business writing for a living and it's rare to find someone who can do this, so well done! I have all three of your books and haven't noticed any errors either. Have you got a target date for publishing yet?8 February 2012 at 9:38 | Alison Reeves - Alison,
Do you often see proof readers willing to pay for the privilege?8 February 2012 at 13:01 | will - I am excited about FV. However, I have to ask, how is FV superior / more conducive to productivity than Superfocus?8 February 2012 at 13:15 | Mauricio
- Mauricio:
<< I am excited about FV. However, I have to ask, how is FV superior / more conducive to productivity than Superfocus? >>
The main difference is that both SF and AF tend to result initially in the minor/easy tasks being processed first, while the "squeeze" is only put on the more difficult tasks gradually. In FV this is not the case.
An associated problem with SF/AF is that there is a tendency for the list to get packed with easy tasks which give an illusion of progress. What is actually happening thought is that the easy tasks on a page get dealt with quickly, while the more difficult tasks only get dealt with a few at a time. So typically a new page will have 30-40 per cent of its tasks dealt with on the first couple of passes, but in later passes the proportion of tasks will fall dramatically. This results in a large number of active pages.
In FV there is no pay-off for packing the list with easy tasks, so the length of the list is dramatically reduced. The processing of tasks is much more even throughout the list, with the result that the list tends to be concentrated on a few pages (my current list has 4 pages, but there are only 2 tasks each on the first and last pages).
Also unlike SF/AF, the FV list is dealt with as one list. The page divisions are not significant (and in electronic versions are not needed at all).8 February 2012 at 15:01 | Mark Forster - This looks and sounds great, Mark. Do you have a target date when all of your loyal followers will see your new book?8 February 2012 at 15:42 | David Drake
- <<Alison, Do you often see proof readers willing to pay for the privilege?>>
No will - it's usually the author who pays for proofreading! However it is obviously a service that Mark is happy to perform himself!8 February 2012 at 16:46 | Alison Reeves - David:
<< This looks and sounds great, Mark. Do you have a target date when all of your loyal followers will see your new book? >>
I'm planning to do a lot of the writing while I'm away in Australia next month. Back 12 April!8 February 2012 at 17:21 | Mark Forster - I have the same experience. In AF4 the easy tasks get done quickly and then the non-trivial tasks clog up the pages. The easy tasks give an illusion of progress, so it is always fun to work on the easy tasks. The more challenging tasks remain unprocessed.
A random thought that just occurred to me is to leave some lines after a hard task that can be filled with easy tasks related to that hard task. Maybe leave 4 blank lines. This way when it's time to work on the hard task I have to come up with an easy task first. Once I complete four easy tasks then I can move the hard task to the end of the AF4 list, again leaving a few blank lines after it.8 February 2012 at 17:21 | Asim Jalis - <<The easy tasks give an illusion of progress>>
Seth Godin remarked (I forget where/when) that this problem is inherent with all task management systems.
I think Steve Pressfield (War of Art), Julia Cameron (Artists Way), Stever Robbins (Action Days), S. Covey's (Weekly Planning/Roles/Goals, Ziglar/Godin (4 Pack) & Mark's dreams all have something to say about meaningful progress.8 February 2012 at 18:24 | avrum - Mr. Forster,
Thank you for all your work on these systems. They are very helpful for this engineering student. I'm looking forward to reading your book when it is published.
In the meantime, are you willing to divulge whether the dots on your list here relate to the urgency of those items?
Thanks,
Austin9 February 2012 at 0:02 | Austin - Austin:
<< are you willing to divulge whether the dots on your list here relate to the urgency of those items? >>
No, they don't relate to urgency as such.9 February 2012 at 9:23 | Mark Forster - +JMJ+
<<No, they don't relate to urgency as such. >>
From looking at all the clues---the pictures, the latest blog entry, the blog entries on importance and urgency---I would guess that the dots are actually related to IMPORTANCE, not urgency.
The latest blog entry says that, with respect to difficult vs easy items, FV's "processing of tasks is much more even throughout the list." Initial sorting or tagging of items by importance fulfills this: no matter how easy or difficult an item is, if you can't "put up" with it not being done for too long, then you'd ought to do it.
This tagging also fits well into Mark's latest definitions of importance and urgency: "If the answer to any of these questions ['How long can I put up with something?'] is 'indefinitely', 'never' or 'I don’t know yet', then you can remove the project from your list for now" (markforster.squarespace.com/blog/2012/1/30/how-do-we-tell-how-important-a-task-is.html ). Conversely, if items are important enough, they ought to be worked on first, prioritized by urgency, and the initial way to do this (aside from listing them in a separate list) is tagging them, e.g. a dot.
Of course all of this is just speculation, and of course there are still some unanswered questions. First of all, if all of these are correct, then how does Mark tag the "important" tasks? And second, how could the system be "designed to produce the right load for the time available, but it is also designed to ensure that this load consists of the right stuff. Not only that, but in the process goals will be clarified and worthwhile emerging new ideas exploited to the full" (http://markforster.squarespace.com/blog/2011/9/19/key-principles-of-the-new-system-ii-universal-capture.html )?
Oh well, I guess we'd have to wait for the book :D9 February 2012 at 10:30 | nuntym - +JMJ+
Oh no, no no no no no no no no no...
No way, Mark, FV's THAT simple? No way!
1. Make list. Add new items as without the dot.
2. From beginning of list, pass through list thinking “How long am I prepared to put up with not doing this task?” If the answer is some time less than "indefinitely" or maybe today or some time soon, then mark it with a dot. Do this until you reach the end.
3. Go back to the beginning and process just the tasks with dots, the Important tasks, according to Urgency (how much time you have).
4. Once a specific event is triggered (get to the end? no action taken on last pass of the Important tasks?) go back to step 2.
No way this is right!9 February 2012 at 11:06 | nuntym - The clues that it can all be one long list and that the focus is on important stuff, rather than easy stuff, makes me think of a Colley's Rule implementation:
http://www.markforster.net/blog/2007/2/5/the-resistance-principle-and-colleys-rule.html9 February 2012 at 11:09 | Frank - @nuntym : I don't know if this is FV, but I may try this sometime soon.9 February 2012 at 13:18 | Laurent
- My speculation was that perhaps dotted tasks were "urgent starting tomorrow" (or in rare cases, today), and that these are processed more frequently (perhaps AF4 backlog style or something similar) than the rest of the list. I think I'll give that a try for a while anyway and see what happens.9 February 2012 at 14:13 | Austin
- nuntym:
<< I would guess that the dots are actually related to IMPORTANCE, not urgency. >>
No, not as such.
<< if items are important enough, they ought to be worked on first, prioritized by urgency, and the initial way to do this (aside from listing them in a separate list) is tagging them, e.g. a dot. >>
No.9 February 2012 at 15:06 | Mark Forster - nuntym:
<< 1. Make list. Add new items as without the dot. >>
Yes.
<< 2. From beginning of list, pass through list thinking “How long am I prepared to put up with not doing this task?” If the answer is some time less than "indefinitely" or maybe today or some time soon, then mark it with a dot. Do this until you reach the end. >>
No.
<< 3. Go back to the beginning and process just the tasks with dots, the Important tasks, according to Urgency (how much time you have). >>
No.
<< 4. Once a specific event is triggered (get to the end? no action taken on last pass of the Important tasks?) go back to step 2. >>
No.9 February 2012 at 15:08 | Mark Forster - Frank:
<< a Colley's Rule implementation >>
Good shot! Colley's Rule does come into it, but not in a way that bears much resemblance to the article you reference.9 February 2012 at 15:18 | Mark Forster - I'm not confirming or denying any further guesses. Don't let me stop anyone from making them though!
One point - the system has changed a lot since my earliest drafts, so things I've said in the past about it may not necessarily still be valid.9 February 2012 at 15:21 | Mark Forster - Qn: << are you willing to divulge whether the dots on your list here relate to the urgency of those items? >>
Ans: <<No, they don't relate to urgency as such.>>
One thing is for sure: Mark would be a cross-examiner's nightmare on the stand... :)9 February 2012 at 15:21 | JD - +JMJ+
To be honest Mark, I'm quite relieved that my guess is wrong ^___^9 February 2012 at 15:48 | nuntym - Mark, you are such a tease!9 February 2012 at 16:35 | Alison Reeves
- I didn't know Colley's Rule before, so it's great to have learned about it!
And please Mark, could you put a nice section of the new book where you give us ideas and ways to use it to optimize our decision making in the course of our lives?
Other concrete ways not confined to what is included in FV :)
Like some stories about you deciding for the best restaurant to choose and you experience with that, whether you use it for mundane or consequential things etc9 February 2012 at 22:18 | Mauricio - This looks like the other lists that Mark has posted. He writes the tasks with no dot, puts a dot in front of the task he wants to work on, then when he's done as much of the task as he wants to, he draws a line from the dot through the task. Drawing a vertical line through the dots of tasks that have been worked on makes it easier to see the unactoned items. So I think this is the same, and there's no relation to the urgency or importance of the tasks.
Hope you have a fantastic time in Australia, Mark.10 February 2012 at 11:34 | Margaret1 - Colley's Rule is fascinating! I was wondering what odds it truly yielded of obtaining a high value, but I found no entry at Wikipedia. So I tried my hand at it on paper, and it turned out to break down easily once I sketched it as a histogram.
BOTTOM LINE (so you don't have to skip to the end ;)
Compared to a single random pick, Colley's Rule doubles your chances of hitting the narrow top percentiles while sharply throttling your chances of hitting the corresponding bottom ones.
In the middle ranges, there is a nice payoff, e.g. if you want to land in the upper half, Colley's Rule gives you a 75% chance, vs. the 50% of a single random pick.
By quartiles, the breakdown from highest to lowest is: 44%, 31%, 19%, 6%.
Your chances of achieving "mediocrity" (middle two quartiles) are exactly 50%.
ANALYSIS
Consider N items of random rankings, and list them in a histogram from lowest-ranking to highest. Note that you will not encounter them in ranked order when executing Colley's Rule, but for analysis, the histogram of outcomes will be drawn in rank order. Draw the height of each histogram's bar to represent the number of outcomes obtaining that item. The leftmost item will have no bar (zero height), because Colley's Rule never obtains the very lowest item, since it always obtains something higher than your first pick. The second-lowest item will have a height of one, meaning that the only outcome obtaining this item is to pick the very lowest item first and then happen upon that second item next. The third-lowest has two outcomes: You might first pick the lowest item or the second-lowest item, followed by picking the third-lowest item. You can see that the very highest item has N-1 outcomes, by picking any of the other N-1 items first and then happening upon that very highest item next.
We can now find probabilities for any single item or group of items by adding up their bars and dividing by the grand total of all bars. The whole enchilada is a stair-step pattern from 1 up to N-1, whose bars sum to:
(N-1)*N / 2 = total number of all outcomes = sum of all bars
Similarly, the sum of the first m bars is:
(m-1)*m / 2 = sum of bars 1 through m
So, the probability of obtaining any of the first m items is:
m*(m-1) / (N*(N-1))
Now, just let N go really large, and express m as a fraction of N—say, u=m/N:
P(lower u) = u*u, where u is a ratio from 0.0 to 1.0 (e.g., u=1/3 refers to the bottom 1/3)
P(above u) = 1-u*u
NUMERIC RESULTS
2% chance of landing in the top 1% (above u=99%)
19% chance of top 10% (above u=90%)
44% chance of top quartile (above u=75%)
75% chance of top half (above u=50%)
19% chance of 2nd-lowest quartile (bottom half minus bottom quartile)
6% chance of bottom quartile (lower u=25%)
1% chance of bottom 10% (lower u=10%)
0.01% chance of worst 1% (lower u=1%)
GENERALLY ...
2*e chance of landing in a small upper "e" percentile
e-squared (tiny) chance of landing in a small lower "e" percentile
QUARTILES (isn't this fun?)
44% top quartile
31% 3rd quartile
19% 2nd
6% bottom
MEDIOCRITY
Your chances of hitting the middle half (2nd and 3rd quartiles) are precisely 50%.
EXTENSION
Well, then ... suppose we made a third cascaded pick? I.e., after encountering that second item, keep looking for a third item to beat the second. Roughly, we would have a parabolically rising staircase instead of a linear one, and the probabilities would have a steeper cubic shape, pushing us further toward the top. If you are really looking for gold or strongly averse to junk, the payoff would be worth the small additional effort.10 February 2012 at 17:46 | Bernie - Bernie:
Erm! Ok!
I think I forgot to say in the article that you take as your benchmark the first house (or whatever) that meets your specifications. Therefore by definition you would already have a satisfactory result even if you bought the benchmark house and it was the worst example available.
Bear in mind that with the sort of items it is usually used with, houses, cars, restaurants, job offers and the like there is unlikely to be a huge number available that meet your specifications. So adding another pick may simply result in your running out of choices.10 February 2012 at 18:32 | Mark Forster - Colley's Rule doesn't work if there are too few choices, especially if you don't know exactly how many there are (which is often the case).
Let's say you expect 5 acceptable job offers. There's a 1/5 chance that the best one arrives first -- and you reject it. You then reject offers 2-5 because they're inferior. If you know there will be 5, that's fine -- when #5 arrives you take it. If #5 never comes, though, you're stuck.
Ideally, the rule include something to prevent this. Maybe "after x offers, lower your standards to the 2nd best seen so far."
Then there's Paulo's Rule. You reject more than one, then take the best. There are some simulations, but I lost the page. Paulo's was better than Colley's, but the testers didn't agree on the "win" criteria, or on how many to reject.
I like Feynman's Dessert Method: Always take the chocolate. It may not be the best thing on the menu, but it's probably pretty good. Besides, it's only dessert.10 February 2012 at 19:14 | Cricket - I think too many people follow Feyman's dessert method. As a fruit fan, I am regularly disappointed as restaurants offer 4 chocolate desserts and one mediocre 'other'.10 February 2012 at 19:26 | Alan Baljeu
- Mark,
<<I think I forgot to say in the article that you take as your benchmark the first house (or whatever) that meets your specifications. Therefore by definition you would already have a satisfactory result even if you bought the benchmark house and it was the worst example available.>>
Sure, you did mention that, and I took it into account. Here is how my analysis applies to the house scenario:
Before shopping, you make your list of specifications. At the moment you finish the list, there are N houses that meet your specifications. You don't know where they are, and you don't have them on an itemized list, and you don't even know the value of N, but they exist right at that moment in your neighborhood (or whichever neighborhood(s) you listed in the specifications), and there are N of them, whether that is 5 or 500.
Now you go out shopping. The first house you discover that meets your specifications is the "benchmark" house. In my writeup, it is that "first pick" which leads to the histogram bars. Mathematically, you have just drawn from N lottery tickets. Physically, you have arrived at the first of N pre-existing acceptable houses.
You leave that house, per Colley's Rule, searching for a second house that is more desirable than the benchmark. At this moment, there are N-1 or fewer remaining houses that meet your specifications *and* are more desirable (to you) than the benchmark house. Again, you don't know what this number is, nor do you have a list of these houses, but they exist, and there is some definite number of them less than N. By continuing to shop until you find your first house more desirable than the benchmark, you are now drawing from a second lottery, in which certain tickets have been removed. The remaining tickets correspond to all the houses of the original N that you would find more desirable than the benchmark. Physically, you trudge through additional houses that were never represented by lottery tickets, but they don't need tickets, because you were never going to draw them.
The above leads to the staircase histogram, which results in all the rest of my figures.
<<Bear in mind that with the sort of items it is usually used with, houses, cars, restaurants, job offers and the like there is unlikely to be a huge number available that meet your specifications. So adding another pick may simply result in your running out of choices.>>
I did play around with small sample sizes, and actually the results are much the same. I just didn't write up the small samples, because the mid probabilities vary so much with N.
Let's try N=6:
P(top 1 of 6 houses)=33%
P(top 2 of 6 houses)=60%
P(top 3 of 6 houses)=80%
P(2nd worst of 6 houses)=6.7%
P(worst option)=0%
("worst" = least desirable of the houses that meet your specifications)
Not bad! Again, Colley's Rule doubles our chances of hitting the top, versus a random pick. Had you merely selected your first acceptable house, you'd have played Russian Roulette. Instead, just by discovering one more acceptable house, not even seeing two-thirds of the acceptable field, you have given yourself an 80% chance of landing in the top half of desirability and nearly a 2/3 chance of top third.
Again, I realize all six of these houses are acceptable, but the purpose of Colley's Rule is to make a quite nice choice with a minimum of comparison effort. I am measuring its success by looking at its odds of selecting our most desirable options. It remains quite effective at that for low N.10 February 2012 at 21:56 | Bernie - Cricket,
<<Let's say you expect 5 acceptable job offers. There's a 1/5 chance that the best one arrives first -- and you reject it. You then reject offers 2-5 because they're inferior. If you know there will be 5, that's fine -- when #5 arrives you take it. If #5 never comes, though, you're stuck.>>
A very good point, but it is not exactly a flaw in Colley's Rule. The problem is the time dependence, the fact that you have to reject the benchmark before looking at other options. That is not a problem in Mark's house scenario, though I guess in a competitive real estate market, your benchmark *might* get snapped up while you are looking for that second house. Hopefully you would get on with it and find that second house (or give up) quickly, so the benchmark would still be available. Perhaps even put a small deposit on it. I think we were able to reserve our house for 24 hours without putting down any money at all.
But if you must firmly cancel the benchmark before you continue, then the small numbers certainly cause trouble. Mark did mention job offers in passing, so yes, we need to watch for that before running with Colley.
But if we apply Colley's Rule to a to-do list, then certainly the benchmark is not going to disappear on us.10 February 2012 at 22:07 | Bernie - On perfectionism and Colley's Rule:
Those of you in computer science will recognize the similarity to sorting/ranking algorithms. And all of us on this board will notice the applicability to perfectionists' troubles with decision making.
In a classic ranking problem, we want to find the highest value among N items. The perfectionist (or 100% accurate computer program) needs to find the *best* answer to this, which requires N-1 pairwise comparisons (among the acceptable items alone; if you count the rejections of non-acceptable items, it is somewhat more, but they do not count against the N). For N=6 houses, the perfectionist must discover and visit every acceptable house, keeping a running "winner" in his mind, and always updating the winner upon reaching a better house. After examining the final house, the perfectionist buys the absolute best one.
I don't pretend to know Mark's mind on how this applies to a to-do list, and I'm not fond of guessing (though I'm willing to be entertained by others' guesses!), but here is one example of how Colley's Rule can help a perfectionist when facing a to-do list:
You have 73 items on a multipage to-do list, and you want to pick the perfectly very best, tip-toppest one to work on right now. Your specification is merely "an item on this list." You must make 72 comparisons. Start at the beginning, scan to the end, keeping a running winner.
But given Colley's Rule (and maybe a shot of whiskey), you can take the first item as your benchmark and just scan until you meet a better one. Statistically, you can expect to scan half the list, 36 items instead of 73, before finding a better one. If there is trouble starting at the "first item" because there is too much structure (non-randomness) at the end/beginning of the list, then turn to a random middle page to begin your search, wrapping around at the end.
This gets better, of course, if you have a real specification, such as "items that I pre-marked with a dot because they're urgent" or "items that feel ready to be done," etc. Then you will make even fewer comparisons, because it will take much less effort to reject the items that don't meet specification.
Not that we have any perfectionists around here, at all, but if I were one of them, I might be really excited about applying this rule ... right now ... as I choose a new local bank. Specification: no monthly service charge, conveniently located ATM's, no fee for OFX download, offers Health Savings Account ... I have a pile of brochures. Maybe I don't need to read *all* of them!!10 February 2012 at 22:12 | Bernie - Bernie wrote:
<< This gets better, of course, if you have a real specification, such as "items that I pre-marked with a dot because they're urgent" or "items that feel ready to be done," etc. Then you will make even fewer comparisons, because it will take much less effort to reject the items that don't meet specification. >>
Colley's Rule applied to a pre-filtered ToDo list.
Hmmm...(looks at Mark's list)...hmmm.....very interesting :)11 February 2012 at 9:41 | Frank - Since FV incorporates Colley's Rule, I hope it also includes a way to systematically apply the 80-20 rule (The Pareto principle)11 February 2012 at 14:44 | Mauricio
- Has Beeminder or the Akrasia principle influenced the working of FV?11 February 2012 at 17:15 | Chris
- My next wild speculation is that items which are landed on as a benchmark are dotted. A special rule could prevent passing through the list twice without having a chance to do the ones you land on as a benchmark twice.11 February 2012 at 18:27 | Austin
- +JMJ+
@Frank: <<Colley's Rule applied to a pre-filtered ToDo list.
Hmmm...(looks at Mark's list)...hmmm.....very interesting :)>>
Which is what I am trying to work up it with at the moment, but the pre-filtered list is DWM2:
http://markforster.squarespace.com/forum/post/1677525#item172518411 February 2012 at 19:26 | nuntym - The claim I find most intriguing about Mark's "Final Version" is that he is able to keep the list stable to about four pages. The harder items don't clutter up and stretch out the list. He also no longer uses closed lists. So it's a single running list. And the completed tasks are evenly spread out, not concentrated at the beginning or at the end.
I am just wildly speculating here, but one way to do this could be to have a rule where you do one task per page. If there are no tasks on the page that can be worked on you dismiss a task from the page. So you either complete a task or you dismiss a task from each page. And you keep cycling through the pages.11 February 2012 at 19:54 | Asim Jalis - I was thinking about how Mark is able to keep the list evenly processed and also keep a single list. Maybe it's this: Pick the first task and complete it. Then pick a second task and complete it. Starting with the third task, each task must be between the last two tasks that were completed. Gradually this band will narrow. When there are no more tasks that look appealing, dismiss one of the tasks and start again.11 February 2012 at 20:15 | Asim Jalis
- I'm fascinated as a newbie to SF, but also exhausted from reading all the nuances, best practices, and rules, and speculation and possibilities, while every 2 minutes there's a new system to learn and adopt. I had high hopes, but I have to ask why the guru is changing systems every few months? It's such a time sink for me to try to follow the master when the master is constantly in flux. I have tried every system in the galaxy and had thought I was landing with the ultimate, but it's not even stable for one full year. i'm now really depressed at having spent so much time reading about SF and all the nuances and how it's better than everything before and and and and ... I may have to say goodbye and go back to the old ways...11 February 2012 at 23:31 | Leigh
- I'm guessing the dots work like Mark used them in AF1: as you are scanning the list, put a dot next to the item that stands out.
In AF1, you'd start working on this item immediately, for as long as you want. When you decide to stop, you'd re-enter the item at the end of the list, and then cross off the dotted item.
For FV, I'm guessing the dot still means "it stands out", but then I have some other ideas of how the item gets processed.
First idea: Mark scans the whole list, putting a dot next to any item that stands out. BUT, no action is taken immediately - the scanning just continues. After a pass through the list, you've got a few items with dots, and having circled through everything, you now come back to the first item. It becomes your Colley's Rule baseline. Skip it, and move on to the other dotted items. When you come to a dotted item that stands out MORE than the baseline, take action, working as long as you want. When done, cross off the item, re-entering at the end if recurring or unfinished. Move forward to the next dotted item, which is now your new baseline. Action the next dotted item that stands out MORE than the baseline. .... If you go through all the dotted items and nothing stands out more than the baseline, that would indicate you don't have enough dotted items, so cycle through your whole list again and create a new set of dotted items. Or something along these lines.
(2) (TOTALLY DIFFERENT GUESS) Read through the items in the list in order. When an item stands out, put a dot next to it, and then work on that item as long as you want. When you decide to stop working: (a) If it's a recurring item, cross off and re-enter. (b) If it's FINISHED, then cross it off. (c) If the task is UNFINISHED, then leave it there, dotted. Then continue cycling through the list. After awhile, you'll have dots on all the tasks you've started but didn't finish. This tells you how many plates you are trying to keep spinning before they all come crashing down. And it also helps unfinished work to stand out more since they already have dots. It also slows down the growth of the list since there's less re-entry.
(3) Some combination of (1) and (2)?12 February 2012 at 6:44 | Seraphim - Evidence for my guesses:
I think the evidence is strongest for guess #2. I don't see any non-recurring tasks that are rewritten. The rewritten tasks are either typical recurring tasks (FTSE, Blog GED, Email) or what appear to be project tasks (Fund Raising Action, which I take to mean "scan the fund raising project and take an appropriate next action").
The only exception I noticed was "Sunset Boulevard", in quotes, which I would guess is the 1950 film. This one is re-entered once or twice, but it doesn't makes sense as a recurring task.
So, I would guess this means that "Sunset Boulevard" is actually a television show that I couldn't find on Google, so it's actually a recurring task.
Or, it was a task that Mark started (i.e., watched a bit of the film). But subsequently, it just didn't stand out anymore at all, and at some point Mark decided to delete it. But sometime after that, he changed his mind and entered it anew.
(For those who don't know, Mark does really apply the "little and often" technique to his film-watching!)
I think the main evidence against my #1 guess is that Mark's solutions are generally much simpler and more elegant than that. Guess #2 has more of the feel of something Mark may have actually invented (or at least tried) - at least in my estimation. :-)
In any case, I find those photos excruciatingly difficult to read, so all my guesses may be hogwash. :-)12 February 2012 at 6:59 | Seraphim - Seraphim, even if your not right I love the detective work, you really seem to have an indepth understanding. This is great stuff!12 February 2012 at 9:08 | leon
- BTW, I'm wondering if Mark has set an upper limit for dotted items? Perhaps 5 or 6. But this might easily get messy and one could easily lose track.12 February 2012 at 9:11 | leon
- Seraphim wrote: << For FV, I'm guessing the dot still means "it stands out" >>
In my mind, and given how Mark's past systems work, I would say this has to be assumed as a fact.
I'm also thinking that the sub-list (of stand-out items) might be processed through Colley's Rule according to your idea #1. Even if that's not the case, it sounds on the surface like quite an intriguing system anyway - might give it a try :)12 February 2012 at 10:21 | Frank - Leigh
<< I'm fascinated as a newbie to SF, but also exhausted from reading all the nuances, best practices, and rules, and speculation and possibilities, while every 2 minutes there's a new system to learn and adopt. I had high hopes, but I have to ask why the guru is changing systems every few months?>>
There is only one system recommended at present on this website and that is SuperFocus http://www.markforster.net/blog/2011/2/10/rules-for-superfocus.html . That has been the case for quite some time now. All the other stuff is simply discussion and experimentation.
<< It's such a time sink for me to try to follow the master when the master is constantly in flux. >>
Are you asking me to stop developing new and better systems? You are under no obligation whatsoever to follow every suggested new idea on this site.
<< I have tried every system in the galaxy and had thought I was landing with the ultimate, but it's not even stable for one full year. >>
If you buy a computer program don't you expect the developers to keep on improving and developing it?
<< i'm now really depressed at having spent so much time reading about SF and all the nuances and how it's better than everything before and and and and ... I may have to say goodbye and go back to the old ways... >>
Why? The discussions don't affect how well SuperFocus works. Nor do they make your old ways any better than they used to be.12 February 2012 at 11:19 | Mark Forster - Seraphim et al:
It's fascinating how many different conclusions can be drawn from the same bits of evidence!12 February 2012 at 11:41 | Mark Forster - Mark - though I'm back to using Covey's basic ideas, with Ziglars/Godins 4-pack goal-setting process, I admire your ability to create hype. Very impressive.12 February 2012 at 14:32 | Avrum
- Avrum:
<< I admire your ability to create hype >>
and keep you reading this website apparently.12 February 2012 at 16:06 | Mark Forster - >I'm guessing the dots work like Mark used them in AF1: as you are scanning the list, put a dot next to the item that stands out.<
My guess is that too. it's entirely consistent with Mark's comments that it is not about importance or urgence "as such".
In terms of continuing to tease us all, I wonder if Mark is planning to create a pre-release video of further notebook shots against a background soundtrack of "The Final Countdown".. perhaps with the lyrics adjusted to "the Final Version.."
In any case if I keep bating my breath for much longer, I might keel over :)
Very much looking forward to it Mark.12 February 2012 at 22:00 | Mike C - > In any case if I keep bating my breath for much longer, I might keel over :)
Better keep that oxygen tank handy...don't forget that this will only be FV 1.
And we'll still have to work our way through FV1/AF1, FV1/AF4, FV1/DWM, FV1/SF3 etc... until FV2 comes out, or will that be the Final Final Version, FFV? :)12 February 2012 at 23:43 | Frank - I think some of you are doing a real disservice to the rest of us on this site who appreciate Mark's work. The ungrateful comments mocking the author from whom you benefit is out-of-line. Before clicking "Create Post" be sure to erase the acid-laced sarcasm and replace it now and again with the well-deserved words, "Thank you". Thanks Mark! I hope you see improvements to be made on any Final Version and help us adjust each time to a better and improved method. People that hate change rarely do. Cheers to innovation and constant never-ending improvement.13 February 2012 at 5:51 | Michael
- Frank:
<< don't forget that this will only be FV 1 >>
No, it's called the Final Version because that's what it is. MY final version. Once it's published that's what I'm sticking to. And that's why it's so important to me to get it right before it's published.13 February 2012 at 8:41 | Mark Forster - Michael:
Thanks for the support, but I have to say that it's not come over to me as unpleasant mockery at all.13 February 2012 at 8:42 | Mark Forster - Michael:
Not sure what sarcasm you are talking about. My comment was only a bit of fun hinting at the fact that even if it's Mark's final version, the folks on the forum are still going to tweak and tweak.
That's just the nature of these time management systems because often the "problem" is not really time management but self-management (in just using the system consistently as it is).13 February 2012 at 9:03 | Frank - Well my comments were entirely sincere and I hope they didn't cause Mark any offence. I've been following his systems ever since Get Everything Done, and still use that one sometimes in high stress overloaded situations ( the time-slicing technique). It has dug me out of many a hole. Superfocus is overall the best so far, and I am genuinely anticipating FV with excitement.
I still like the pre-release video idea - but then I am in marketing, and I get enthusiastic about such things..13 February 2012 at 12:04 | Mike C - I was referring to two comments:
1. Avrum's "hype" comment above.
2. James' comment from Mark's "What to look out for" post.13 February 2012 at 12:33 | Michael - That was a bit obscure, Michael, especially #2. I think several people thought you were referring to them when you weren't. Nevertheless, I appreciate your sentiments!13 February 2012 at 17:23 | Mark Forster
- <<doing a real disservice to the rest of us>>
Even if I were taking a shot at Mark (I was not. I was admiring how Mark was handling the PR of his latest system) how is this doing a disservice to you?
And while Frank was joking, I think there's more than an element of truth in his post. I admire Mark's innovation and improvements (bodes well for my low tolerance for boredom and procrastination (read: changing systems to avoid work), but think consistency is better for (my) piece of mind (GTD, 7 Habits, etc).13 February 2012 at 19:02 | avrum - Avrum:
<< but think consistency is better for (my) piece of mind >>
and mine too!13 February 2012 at 22:13 | Mark Forster - @Seraphim: Oh, no. I think I've got it.
Observe the dot pattern of the unactioned items on the last page:
d..dddd.... (stop here. I guess all the following are subsequently added items. d stands for a dot, and the dot stands for...well... no dot)
And look closely at the three following striked items. Only the two first seem to have gotten a dot. The third one seems to have a single stroke, without a dot. Which would give :
d..dddd....dd.
I am certainly seeing what I want to see here. But if I'm guessing right, the dotting process is this one. It's done for each page:
1. Put one left-hand finger on the first unactioned item and one right-hand finger on the last unactioned item of the page.
2. Compare these two items. Determine the one that stands out most (or whatever. I'm no good when it comes to details)
3. With your teeth, pick up your pen and manage to draw a dot in front of the chosen item.
4. Move your left finger down one unactioned item and your right finger up one unactioned item.
5. If your fingers did not cross each other, go to 2. Else, you're done with the page.
I don't remember the exact wording, but Mark said something like the page size is of no importance to the speed at which items get processed. You may think that it indicates that the list is processed as a whole, not page per page. Wrong. The page size has no importance. With this technique, 50% of a page will be done at every pass. Whatever the page size, you will always process half of the items on it, even if they are hard. If you make pages smaller, you will only go from page to page faster.
And about Colley's rule... It says:
1. pick the first one that meets your specification as a benchmark
2. take the next one that's better than the benchmark
1. is unapplicable with Mark's philosophy. If it's on your list, it meets your specification. It is important. It needs doing. ("If it's not important, why is it on your list in the first place?") Therefore, as any of the two is a suitable benchmark, both are valid to be the underdog with regards to the other. It boils down to : Get two. Choose. Period.14 February 2012 at 11:46 | Laurent - Bernie, Mark, and anyone else interested in Colley's Rule:
Finding the "best decision" is a well-known math problem, sometimes known as the Secretary Problem. Although Colley uses the very first opportunity as a benchmark, the best solution is actually to evaluate and reject the first 37% possibilities, and then take the next possibility that is better than all of the preceding 37%.
If the number of possibilities is small (houses, checking accounts) then Colley might provide similar results, but it's nice to know that you can confidently scale up to any sort of decision.
If you're wondering where 37% came from, it's actually 1/e. For more details, see:
http://en.wikipedia.org/wiki/Secretary_problem14 February 2012 at 16:14 | FSE - FSE:
Fascinating. I think the alternative name "Sultan's Dowry Problem" sounds much more interesting than "The Secretary Problem"!
However I get the impression that it's directed at a different problem from Colley's rule in that Colley's rule is a method of making a relatively quick decision with a good chance of a high quality result. The aim is basically to save time and effort.
The Sultan's Dowry method on the other hand is not concerned in the least with saving time or effort but with how you get the highest chance of getting the best result when there is no going back on the individual decisions.14 February 2012 at 18:24 | Mark Forster - The Sultan's dowry is rather artificial. The dating game is a more natural fit: To find the perfect mate, you might date people serially until you pick whom you hope is the best - but no going back to previous rejects. So you reject the first 37% and then pick whomever is better than all those. High probability of finding the perfect mate, but also a 37% chance of missing and getting nobody!
But not necessary in task-picking where you will ultimately pick many and none are truly urgent.
Laurent: "3. With your teeth, pick up your pen and manage to draw a dot in front of the chosen item."
Could that be Mark's key new idea? 8-$14 February 2012 at 20:58 | Alan Baljeu - Laurent,
"1" does apply because items can be out of context or not suitable for the time available. If I have 30 minutes between classes, my system needs to be able to select a suitable task. Previous systems couldn't always do this; for instance, with AF1 if the page I'm on does not have a suitable task for the time available, I'd either have to dismiss a page unnecessarily or apply the escape rule.
Using Colley's rule, I can choose as my "benchmark" the "next item that could be done now" (given my location, time available, etc.), and then pick the next item that would be better to do npw.14 February 2012 at 22:20 | Austin - Also, we have already been told that there is no significance to the pages.14 February 2012 at 22:24 | Austin
- Mark:
Actually, I'm pretty sure Colley's rule was also intended for decisions that cannot be revisited.
Otherwise, the decision procedure is trivial. If you look at half of the possibilities and choose the most favorable from them, then you will have a 50% chance of making the optimal choice (but take only half as long as looking through all the possibilities). Of course, you can replace "half" with "three-quarters", "a third", etc. depending on how much you value your time against your need for perfection. There is no right answer, because it's a matter of personal preference.14 February 2012 at 22:44 | FSE - FSE,
<<Finding the "best decision" is a well-known math problem, sometimes known as the Secretary Problem. Although Colley uses the very first opportunity as a benchmark, the best solution is actually to evaluate and reject the first 37% possibilities, and then take the next possibility that is better than all of the preceding 37% ... http://en.wikipedia.org/wiki/Secretary_problem>>
Thanks for that article! It also says that your chances of finding the *very best* candidate this way are 37%, which sounds quite impressive. Imagine your chances of hitting the top two or top three ...
As Mark summarized nicely (vs. Colley's Rule),
<<The Sultan's Dowry [a.k.a. Secretary] method on the other hand is not concerned in the least with saving time or effort but with how you get the highest chance of getting the best result when there is no going back on the individual decisions.>>
This made me wonder how much Colley's Rule really trades off, quantitatively, in pursuit of a quick answer, and so I discovered that Colley's gives you that same 37% chance of landing above the 80th percentile (of desirability).
I think this makes a very strong statement for Colley's: by relaxing the benchmarking process from 37% of the entire field to just ... (wait for it) ... one item (!!), the effect is to spread our luckiest 37% outcome over the top 80th percentile, versus the single best item. Definitely a tradeoff, but not bad for a quick pick, eh?
Here is the math (Colley's):
P(above 80th percentile) = 1 - 0.8*0.8 = 0.36
... so 37% cuts off at the 79-point-something percentile.
Cricket,
This Secretary/Sultan's problem addresses your point about job interviews that cannot be revisited once rejected. Unfortunately, their "37% chance of best candidate" relies on large-number analysis, but ...
Applying their 1/e rule to your scenario of 5 interviews, you would take and reject the first two interviews (2 being 37% of 5), then look for something better among the final three. I don't know, I think I'd prefer Colley's again. Throwing away two of five interviews makes me nervous! Throwing away even one of five? Maybe.15 February 2012 at 2:38 | Bernie - Bernie,
<<Here is the math (Colley's):
P(above 80th percentile) = 1 - 0.8*0.8 = 0.36
... so 37% cuts off at the 79-point-something percentile..>>
That's not really the math for Colley's rule. ... You are giving the probability of landing in the 80th percentile if you plan to make your final decision after seeing only two options. No benchmarking is involved here.
I should also point out that Colley's rule, like the 37% rule, was also intended for decisions that could not be revisited.15 February 2012 at 6:36 | FSE - FSE:
<< I should also point out that Colley's rule, like the 37% rule, was also intended for decisions that could not be revisited. >>
I'd be interested to know your authority for that statement. Whether or not that is true, Colley's rule works best if you can revisit the decisions - which will be the case in most real-life situations. If no better choice than the benchmark appears by the time you have exhausted all the possibilities then you take the benchmark. The larger the number of candidates the less likely this is to be necessary.
I have used Colley's rule in many situations and it has proved itself in use many times. I cannot imagine how I could use The Secretary method in real life. Just look at the difference in procedure:
In The Secretary you don't even get your benchmark until you have looked at over a third of the candidates. And to do that you have to know how many candidates there are - which will not be the case in many real life situations.
In Colley's rule you don't need to know how many candidates there are, and there is a high probability you will arrive at a solution very quickly - which is the entire purpose of the rule.15 February 2012 at 9:15 | Mark Forster - Austin wrote:
>> Using Colley's rule, I can choose as my "benchmark" the "next item that could be done now" (given my location, time available, etc.), and then pick the next item that would be better to do npw. <<
Conceivably, FV could just be as simple as that and that would also accommodate fast-changing conditions such as time available and context.
I remember Mark hinting somewhere that we might think that FV was *too* simple :)
If FV is as simple as "find a task that stands out that you can do now, then actually do the next more-standing-out task you can do now" then what do the dots represent?
Then again, Mark did state earlier: "Colley's Rule does come into it, but not in a way that bears much resemblance to the article you reference" which makes me think this is not the whole story15 February 2012 at 11:14 | Frank - Frank wrote:
<<If FV is as simple as "find a task that stands out that you can do now, then actually do the next more-standing-out task you can do now" then what do the dots represent?>>
My best guess is that a benchmark is dotted so that when you reach it twice as a benchmark, you'll know that this is your second time through the list without having an opportunity to do that item. This in combination with some rule could prevent urgent items from being benchmarked twice without a fair shot at doing them.
<<Then again, Mark did state earlier: "Colley's Rule does come into it, but not in a way that bears much resemblance to the article you reference" which makes me think this is not the whole story>>
I was thinking that, too. But I like what we've come up with. It allows the list to adapt to the context and time available, and is accurate at choosing good tasks to do now. I remember reading that you're supposed to walk away from the Final Version feeling like you've used the time as best as you could have, no matter how much time you have. We seem to be at least headed in the right direction.15 February 2012 at 17:21 | Austin - Mark,
I haven't spoken to Colley (aka Collee) himself, so my only sources are secondhand discussions. Probably the most authoritative one appears in the Financial Times website:
"The rule assumes you cannot go back to any of the choices you reject" (http://www.ft.com/intl/cms/s/0/3a6fbc42-4fd2-11d9-86b3-00000e2511c8.html#axzz1mTAxdrzh)
I think the reason that you need this constraint is that otherwise the solution is underdetermined. In other words: suppose you could look over as many choices as you wanted, and return to any of them at any time. How many should you look at? Well... that depends. If you want a 50% chance of finding the best choice, then you should look at 50% of the total. If you only have time to look at ten out of N possibilities, then you will only have a 10/n chance of finding the best choice.
When you are not allowed to revisit choices, every option you consider has a large cost - you must discard the previous option - for an uncertain reward. That's why knowing when to stop requires guidance from Colley (or the Sultan). It's a bit like poker, you have play the odds.
But with revisitation permitted, it's more like research than poker. The only cost is your time and the only reward is new information. Those are predictable quantities, and the relationship between them is a simple one-to-one tradeoff. There is never a need to commit to an all-or-nothing gamble. Instead, the decision is straightforward: how much do you value your time against your need for perfection. That doesn't require a mathematical strategy, it just requires you to balance your personal values. In this setting, Colley is no better than flipping a coin every so often and ending your search when it lands heads.15 February 2012 at 17:36 | FSE - Frank wrote:
<< If FV is as simple as "find a task that stands out that you can do now, then actually do the next more-standing-out task you can do now" then what do the dots represent? >>
This question led me to think of another possibility, similar to my earlier guesses:
(1) Cycle through the list, looking for an item to stand out. That item becomes your baseline. Do not mark it.
(2) Continue cycling. When you find an item that stands out "more" than the baseline, put a dot next to that item, and work on that dotted item as long as you want.
(3) When you're done working:
(3a) If the task is recurring, cross it off and re-enter at the end of the list.
(3b) If the task is completed, cross it off.
(3c) If the task is unfinished, leave it there on the list, with the dot.
(4) Continue cycling through the list - i.e., start over at (1)
Alternate: Replace "stands out" with "is urgent".
Unsolved: I am still pondering the mechanism by which "importance" and "urgency" get sorted out. I am guessing Mark has some kind of mechanism that sorts this out implicitly, simply by working the system, without requiring pre-processing or conscious decision-making.
But how does it work? It doesn't seem to have any kind of page-based dismissal like AF1 (since it's one long list). There aren't any dates or other indicators anywhere.
Maybe the process of following Colley's Rule works so well that it fine-tunes one's sense of what really belongs on the list, and what doesn't. So after a few passes, you get a strong sense of what is "stale" or "not part of my commitments". And you just delete it.
But I would think there is more to it than that.15 February 2012 at 17:39 | Seraphim - Seraphim wrote:
<< (4) Continue cycling through the list - i.e., start over at (1) >>
Since the task you've just worked on has now "decreased" in the amount that it stands out by (because you just worked on it), I wonder what would happen if you simply choose that task as the new baseline and go further down the list from that point?15 February 2012 at 18:12 | Frank - Seraphim wrote:
<<Maybe the process of following Colley's Rule works so well that it fine-tunes one's sense of what really belongs on the list, and what doesn't. So after a few passes, you get a strong sense of what is "stale" or "not part of my commitments". And you just delete it.>>
I remember a comment from Mark where I understood that FV will be more like DIT.
So “One day’s outgoing work much on average equal one day’s incoming work”
http://www.markforster.net/blog/2010/1/26/do-it-tomorrow-revision-on-its-way.html15 February 2012 at 18:38 | Mauricio - Before you all get into even greater flights of fancy, I'll just remind people of my earlier comment that the FV has changed considerably while I've been working on it so you shouldn't assume that earlier descriptions of it are still valid.16 February 2012 at 1:07 | Mark Forster
- FSE:
The purpose of Colley's rule is to save time. It gives you a simple method of getting a good result in as little time as possible. And you don't need to know how many candidates are available for it to work.
I don't see how anything you've said affects that.16 February 2012 at 1:16 | Mark Forster - FSE wrote:
<<That's not really the math for Colley's rule. ... You are giving the probability of landing in the 80th percentile if you plan to make your final decision after seeing only two options. No benchmarking is involved here.>>
Not at all, FSE. I describe the analysis in detail on page 1 of these replies. I cannot find a way to link directly to my entry from here, but you can find it by clicking back to page 1 and scrolling about 2/3 of the way down. There are a few followups shortly after that shed some more light with a more concrete explanation. Please have a look and let me know if you find errors. We'd better take that to the forum, though, rather than cluttering up this blog post with more equations. I will gladly join you on a new forum thread to iron it out.
Maybe you are looking at the expression 1-x*x and being reminded of the math that arises from a straightforward lottery? E.g., 1-0.8*0.8 does happen to be our probability of winning a 1-of-5 lottery if we are given two chances at it, but that is nothing like the reasoning used in my analysis. The resemblance is pure coincidence.
Instead, I have essentially asked the following:
If 100,000 people, completely independently, made selections by Colley's Rule, what would the luckiest 37,000 people's results look like? The answer is that they would all obtain results in their top quintile of desirable options. I chose 37% in order to compare to the Secretary's case, in which we've learned that the luckiest 37,000 people would actually obtain their very best possible option.
<<... Colley is no better than flipping a coin every so often and ending your search when it lands heads.>>
Colley's is *vastly* better than this! Hopefully a look at the analysis and other comments on page 1 will clear that up. Since Colley's is very effective for small N, you can also confirm this through experiment: write numbers on index cards, shuffle them into a stack, benchmark the top number, and proceed down the stack until you beat it. Make a histogram of your results, and they should beat the pants off of the occasional coin flip or a straight lottery, or even a best of two lotteries ... but I don't recommend 100,000 trials!16 February 2012 at 2:10 | Bernie - Bernie and Mark,
Ok, I just ran some simulations in MATLAB for this problem. Yes, I used 100,000 trials per simulation!
Rather than implementing a coin-tossing scheme, I used a very minimalist alternative to Colley's Rule. Let's call it "The Rule of Three":
"Look only at the first three possibilities. Choose the best one among those three."
It's painfully simple, but believe it or not "The Rule of Three" proved superior to Colley's Rule regardless of the total number of possibilities. I can post a detailed table of results if you want, but here is the executive summary:
1) When there is a small number of possibilities (i.e. between 5 and 20), "The Rule of Three" provides much better results on average than Colley's Rule and takes slightly less time on average.
2) When there is a large number of possibilities (i.e. between 20 and 10,000), "The Rule of Three" provides slightly better results than Colley's rule, and takes much less time.
I have to say that the results somewhat surprised me, but there they are. This tends to reaffirm my suspicion that Colley's Rule was meant to be used in a different setting.16 February 2012 at 6:16 | FSE - FSE:
I haven't done 100,000 trials, but I tried using the random number generator at http://www.random.org/ to see what happened. I ran 5 trials which the generator set at 1-100 and 5 trials at 1-10. Duplicate numbers were removed.
In only one out of the 10 trials did the Rule of Three produce a better result than Colley's. That was with the 1-10 range setting. In five cases both methods produced the same result. And four results were better using Colley's rule.
As far as time goes, the rule of three was obviously faster most of the time (it would be difficult to see how it couldn't be). Even so Colley's rule produced the same result faster on two occasions.
Maybe I was just lucky.16 February 2012 at 11:43 | Mark Forster - Here's the numbers for the above experiment:
1-100:
33 37 9 (Both 37)
100 + another 99 numbers (Both 100)
60 34 49 20 42 7 76 (R3 60; Colley 76)
66 53 14 87 (R3 66; Colley 87)
80 16 7 16 78 55 89 (R3 80; Colley 89)
(Colley 3, R3 0, Draw 2)
1-10:
3 4 10 (R3 10; Colley 4)
2 1 5 (Both 5)
6 9 3 (Both 9)
10 + another 9 numbers (Both 10)
7 3 6 5 4 9 (R3 7; Colley 9)
(Colley 1, R3 1, Draw 3)16 February 2012 at 11:58 | Mark Forster - I've now run a further 10 trials with the generator set at 1-20. Duplicates removed as before. The results were that Colley produced a better result 4 times, the Rule of 3 once, and they produced the same result on the remaining 5 occasions.
There seems to be some discrepancy between my results and yours. So far on the various settings which I've used Colley has produced 8 better results to the Rule of 3's two.16 February 2012 at 12:23 | Mark Forster - I'm no mathematician but surely it's easy to establish the exact odds between Colley's rule and the Rule of Three without having to run 100,000 trials or indeed any at all.
There are only six possible situations in the Colley v. R3 stand-off:
Each of the first three numbers must be either H=Highest; M=Middle; or L=Lowest
The possible combinations are:
L M H = R3 wins
M L H = Draw
M H L = Draw
L H M = Draw
H M L = Colley wins
H L M = Colley wins
Therefore:
1) The chances of both methods producing the same result are 50%.
2) Colley is twice as likely as R3 to produce a better result.
However there is a complicating factor which is what happens if the first number is the maximum. In this case some of Colley's wins will become draws. The likelihood of this happening is greater the lower the total number of numbers. With very a low number it would impact severely on Colley's chances of producing a better result than R3 (though only because both would produce the best available result).
My experimental results with the random generator seem to be in conformity with this.
So my conclusions are:
1) If you know there are only a small number of candidates then it doesn't matter much what method you use since you can probably afford the time to look at all of them anyway.
2) If you know there are a more than a small number of candidates, use Colley's rule.
3) If you don't know how many candidates there are, use Colley's rule.
4) If you can't go back or it would be inconvenient, use Colley's rule.
5) Precision and accuracy aren't the same thing.16 February 2012 at 13:17 | Mark Forster - I have looked closely at the simulations, and discovered that we are both right. For any given sequence, Colley is twice as likely to produce a higher score than Rule of Three. However, in the long run the average score produced by Rule of Three is higher.
This seems counterintuitive, but there is a reason for it: when Colley wins, it tends to win by a much smaller margin than when Rule of Three wins. That means Rule of Three can keep a high average score even with a lower win rate.
I think it's pretty indisputable that Rule of Three is faster than Colley. So I immediately wondered whether I could optimize the rule by trading some of its speed for a better win rate, without affecting its simplicity or hurting the average score.
Without further ado, I present to you ... the Rule of Four!
Just like it sounds, in this rule you look at the first four choices and choose the best one. How does it perform?
1) For n > 10, the Rule of Four will provide higher average scores, has a higher win rate, and is faster than Colley.
2) For n < 10, the Rule of Four will provide much higher average scores and a much higher win rate. However, at this range Colley's is slightly faster, though it is still slower than Rule of Three.
I also looked at a new parameter: how often the results are in the top or bottom quintile.
For Colley's, you can expect to be in the top quintile 50-60% of the time, depending on n. For the Rule of Four, you can expect to be in the top quintile 60-80% of the time, depending on n.
Finally, Colley's ends up in the bottom quintile 2-3% of the time. The Rule of Four ends up there <0.2% of the time.
Perhaps I should apply for a research grant in order to study the Rule of Five ...16 February 2012 at 16:09 | FSE - FSE;
<< However, in the long run the average score produced by Rule of Three is higher. >>
Is it? In my three experiments, totalling 20 trials, The average results were as follows:
Experiment 1 (1-100)
Colley: 77.8
R3: 68.6
Experiment 2 (1-10):
Colley: 7.4
R3: 6.8
Experiment 3 (1-20)
Colley 16.9
R3: 17.0
So R3 just managed to scrape a win in Experiment 3, but I'd hardly call it a convincing one.16 February 2012 at 17:26 | Mark Forster - Mark, could your results be due to the sample size? I just reduced the number of trials down to 7 and ran the results a few times. There was quite a bit of variability, and R3 did not always have the highest score. Here's an example:
Mean score from 7 trials, choosing from 1-100
Run #1: Colley = 61.0, R3 = 70.9
Run #2: Colley = 95.1, R3 = 85.6
Run #3: Colley = 79.0, R3 = 88.6
Run #4: Colley = 75.9, R3 = 82.9
Run #5: Colley = 76.0, R3 = 78.7
But when I dialed back up to 100,000 trials, the pattern was clear:
Mean score from 100,000 trials, choosing from 1-100
Run #1: Colley = 75.3, R3 = 75.8
Run #2: Colley = 75.3, R3 = 75.7
Run #3: Colley = 75.2, R3 = 75.6
Run #4: Colley = 75.3, R3 = 75.8
Run #5: Colley = 75.2, R3 = 75.816 February 2012 at 18:30 | FSE - FSE:
Interesting. How do you explain the great difference in the margin by which the two methods win?
It's all academic though, because the way I use Colley's rule in the Final Version doesn't allow for it to be replaced by the Rule of Three or Four or whatever.17 February 2012 at 0:48 | Mark Forster - I don't know Mark's approach, but clearly a linear application of Colley's rule in Autofocus feels somewhat doable, but a rule of 3 or 4 would quickly engage mental rebellion.17 February 2012 at 2:44 | Alan Baljeu
- Mark & FSE, wow! I guess I won't worry about "cluttering up this post with equations"! ;)
Hopefully I'll have some time tomorrow to look into the Rule of Three/Four.
(a few minutes later)
Okay, it's late, so maybe I'm confused, but ... why is the Rule of Three faster than Colley's (as claimed by FSE)? Buying a house by Rule of Three, I have to find three houses that meet my spec, never two, always three. Colley's will often terminate at the second qualified house, no? I don't think it's obvious which is faster; you'd have to look at various cases of how the houses were sequenced and average over them. Rule of Four would be even slower.
Then again, it is late.17 February 2012 at 6:39 | Bernie - Mark & FSE, now you have done it: I went to bed, but instead of counting sheep, I've been counting histograms!
The first thing I noticed is that my original analysis of Colley's Rule was actually an analysis of "Rule of Two." That's right, take FSE's Rule of Three, cut it down to a Rule of Two, and do the math. You will get exactly what I got for Colley's. Which means, my Colley's is not Colley's!
I think that when I glossed over the items/houses encountered between the benchmark and the final selection, I ended up ignoring combinatorics that affect the result. That is, my linear staircase histogram underestimates the number of ways to reach higher-valued outcomes, because it does not account for the various combinations of the losing houses that crop up after the benchmark. At the time, I thought they didn't matter, but now I think they are going to act as a weighting factor that pushes our probability curve much further toward the higher values. It will make Colley's much more effective than I initially reported.
For example, for N=3, we have the following six possible sequences:
123 --> 2 (Colley's result)
132 --> 3
213 --> 3
231 --> 3
312 --> 3
321 --> 3
And so, P(3) is 5/6, not the 2/3 predicted by my original analysis.
For N=4,
2 ways to get 2:
1234, 1243 --> 2
5 ways to get 3:
1324, 1342, 2134, 2314, 2341 --> 3
17 ways to get 4:
1423, 1432, 2143, 2413, 2431, 3124, 3142, 3214, 3241, 3412, 3421, 4123, 4132, 4213, 4231, 4312, 4321 --> 4
(Double-check: Total "ways" = 2+5+17=24, which is 4-factorial, representing the entire outcome space.)
So the correct P(4) is 17/24, whereas my staircase histogram calls it 3/6.
Correct P(3) is 5/24, vs. my 2/6; correct P(2) is 2/24 vs. my 1/6.
Yeah, I really underestimated Colley! Imagine how much more enamored I'll be once I get it right!!
So, I will start over, no shortcuts, using the entire N-factorial outcome space. I can't say how it will compare to Rule of Three, but it sure looks like Colley's combinatorics are going to pile up very steeply. Since you two are all over the number crunching already, I'll stick to the equations. But first I'll go to sleep. Really.17 February 2012 at 8:57 | Bernie - Should I start a new blog for this discussion?17 February 2012 at 13:56 | Mark Forster
- It is annoying jumping to page 3 of a discussion. It might help to clarify what I think you have in mind as well:
I would not look at the first item, and then seek a more suitable candidate. I would search for the first "good enough" item, and then seek a more suitable candidate. The corresponding Rule of 3 would be rather more difficult: "Find 3 suitable candidates and choose the best". Definitely not just a pick 3 task any more.17 February 2012 at 16:16 | Alan Baljeu - It occurs to me that my implementation of Colley's might not be the same as what you have in mind. In the canonical form, you choose the first item better than the benchmark, or the last item in the list (if the benchmark is the highest). In the variant used here, it appears that if nothing is found to be better than the benchmark, then the benchmark itself is used. This does improve the performance of Colley's.
I'm short on time today (ironically, I've procrastinated my real work!), but once I have time I will repeat the simulated comparisons of this Colley variant to the Rules of 3 and 4.17 February 2012 at 18:25 | FSE - [Oops, double posted this comment by mistake. Sorry!]17 February 2012 at 18:32 | Bernie
- Mark wrote:
<<Should I start a new blog for this discussion?>>
I am in favor. Then I won't feel bad for spewing equations at people who don't care about math or those who already feel perfectly comfortable with Colley's Rule.
When I started this, I was skeptical about the quality of Colley's result and wanted some sort of validation to buy into using it when FV comes out. By now, I have seen enough validation and it is becoming a hobby. I will continue posting if anyone wants to, or I will gladly keep it to myself. Either way, I'm going to finish the equations (which are coming along nicely), even if someone settles it by digging up the textbook answer! ;)17 February 2012 at 18:32 | Bernie - [Comment written by Miracle - but he didn't succeed in getting the website to accept it}
I have to agree with Alan B, Colley will not result in mental rebellion (at least in me) compared to the Rule Of Three, or Four or N. (I’m going to call it/them, the Rule Of N – or RON for short). You see, I work as a program manager, managing anywhere between 15 and 20 IT projects, totaling between $15 and $20 Mil at any given time. I’m currently also pursuing my Master’s degree in Information Systems (IS), and an Acquisition course provided by my employer. I also have a family that relies on me as a father and husband, I write Science Fiction and Fantasy, and finally – I have ADD. In short, I have a ton to juggle, and I can’t rely on my brain alone to juggle it for me. I have used several systems, including Steven Covey’s 7 Habits, GTD, and virtually every system Mark has offered. I have used the Rules of Three and Four, as well as Colley’s for at least a month each.
Now I’m no mathematician, but I do know systems. I define an IS as “people using technology, or a tool, to orchestrate and manage a business process.” IMHO – AF, SF, DIT, DWM, FV and their ilk all fit this definition of an IS on a personal level. Now given that people drive IS, not machines, I will not rely on mathematical proofs and statistical analyses to choose between Colley and RON. My criteria have to do more with how a person would use each rule for the purpose of selecting the next task. I have several such criteria, but many do not form a basis for comparison.
For example, using the AF method of processing and doing what “feels ready” does not work for me. Maybe it’s my ADD, or maybe I’m just human, but using the “feels ready” method for a period of several months resulted in my doing tons of little things and ignoring the big things. My list became an aid to, and a written testament of my procrastination. I need a method that foils my procrastination, rather than one that allows it to continue unfettered. Therefore, my method of processing must not base itself on what I ‘feel’ like doing more, but rather on what I ‘value’ more. Both Colley and RON do this and so this criterion of value based judgments does not form a real basis of comparison.
However, I do have two criteria that form a decent basis for comparison: strain on “mental RAM,” and the speed of list traversal.
Studies show that the average person can consciously store an average of up to 7 pieces of information in their working memory (“mental RAM”) at one time. All scientific notions aside – what I need in terms of strain on mental RAM boils down to this: The less mental work needed to accomplish the process of selecting the next task, the better. RON states “look only at the first N possibilities, choose the best one.” So my mental processor must accomplish the following:
1) Look at the first task – determine if it is a “possibility” (ie: “Can I do this now?”)
2) Continue iteratively checking until I find the first possible task
3) Continue iteratively checking from there until I find the second possible task
4) …And then the third, and then the fourth, or the Nth – These N possible tasks may at this point, be found on multiple separate pages
5) Since all are possibilities, I must now hold all N tasks in my mind, and perform a value based evaluation to determine the best one
For example, considering a Rule Of Four; I would have to evaluate several tasks for the possibility of doing them now – enough tasks to identify 4 possibilities. I must then hold these four in my working memory (that can generally hold a max of 7) and use the remaining 3 “slots” of memory to perform value based judgments between them. I know it’s a simple matter to calculate how many comparisons that would be, but like I said, I’m not a math guy so I don’t care enough to do it. Anyway, after all that work, I would discard 75% of the possibilities that I expended effort finding, just to select one task to work.
Colley on the other hand would break out like this:
1) Look at the first task – determine if it is a “possibility” (ie: “Can I do this now?”)
2) Continue iteratively checking until I find the first possible task, and name it the benchmark – it will be discarded later
3) Continue iteratively checking from there until I find the second possible task
4) Holding the benchmark, and the next possibility in my working memory, use the remaining 5 “slots” to decide which has greater value
5) Either stop here, or discard the possible task and repeat steps 3 and 4
RON requires me to do enough work to identify N possible tasks every single time, guaranteeing that 66% (for Rule Of Three) or more (for Rule Of Four or more) of that work will be discarded every single time I select a task. Additionally, it requires that I compare N tasks together at the same time, or carry a (potentially changing) running favorite through a search for the remaining possibilities.
Colley guarantees that I will discard only those tasks necessary to identify the next best thing. Additionally, it requires that I carry only one (unchanging) benchmark task in my working memory through each comparison, and that I compare only 2 tasks at a single time. Colley 1, RON 0.
Now when I mention list traversal speed, I refer to the amount of the list read (whether acted upon or not). I care about list traversal speed because tons of work flies unevaluated onto my list. It comes from many directions, and I don’t have the time to evaluate everything upon entry (hence GTD didn’t work out too well for me). If my list traversal speed < new unevaluated work arrival, then I end up “chasing the end of the list.” My focus centers on certain parts of my list, and I don’t get much of an occasion to visit the other parts of my list. Therefore I begin to lose touch with the full scope of my work, and without that context, I have more trouble saying “no” to tasks I just don’t have the bandwidth to handle at the time, and my list just fills and fills. I spend more time adding to my list than working it off.
With RON, I must engage in the above mental process (which takes time) to discard at least 66% of that effort upon choosing a task. Upon finishing that task, I cross it off, and then I must begin the next task selection process. This requires that I either recall what possibility #N was from the previous task selection process (that I likely discarded and forgot about as I worked on the task I selected) so that I can begin to identify the next N tasks to compare, or I can simply begin at the next possibility from the last action’d task. However, doing so would carry the likelihood that the next possibility from the last action’d task was a possibility from the previous selection process, meaning that I not only considered possibilities that I discarded in the previous selection, but also that I may re-consider them in the next selection process.
For example: I consider possible tasks A, B, C, and D. I choose to do task B. I then cross B off. I could then try to remember which task was task D, so I can begin locating tasks E, F, G, and H. I could also just begin identifying possibilities from B onward, identifying tasks C, D, E, and F for comparison. In the first case I have to keep track of what D is or remember it somehow. In the second case I would be re-evaluating tasks C and D. Either way slows down my list traversal speed.
Colley has no such additional processing necessary, nor does it risk re-evaluating a given task in two selections in a row. Also, there’s a chance that the benchmark chosen may have a very high value, and so I will have to traverse a larger portion of my list just to find the next better task. So Colley has less processing to hamper progress, and can occasionally result in a higher degree of traversal in a single given selection. Therefore, using Colley results in faster list traversal overall. Colley 2, RON 0.
In my personal experience, RON results in more mental strain than payoff, and slow list traversal. My experience using Colley indicates that it results in less mental strain for a decent payoff, and quick list traversal. My vote: Colley’s all the way.
Mark, I am a big fan of you and your work. Of all the task management systems I’ve tried, none have handled my task variety, task load, and scatter-shot focus as elegantly as your systems. And of your systems, what works best for me is DWM2 (on a 4-day “Letter” cycle, and 15 day “Number” cycle rather than the traditional 7 and 30) processed via Colley’s Rule. Of course DWM2 is really DWM1 in disguise, which of course is really DIT in disguise… The curse of ADD involves never having enough focus to see anything (not even trivial things) through to completion – thereby dooming the poor sufferer to a life of always trying, and always failing. Using your systems as my tools I have managed all of my responsibilities well for years, succeeding in things trivial and grand, without resorting to the use of prescription medication at all. This feels to me like a monumental triumph, the lifting of a heavy karmic curse – like shaking the fruit loose from the tree of possibilities, or finally surfacing from the deep dark depths of the despair of failure, for a breath of fresh air. Your work means a lot to me personally, and I shall wait on the edge of my seat to snatch your next book hot off the press.
-Miracle17 February 2012 at 19:05 | Mark Forster - Thanks, Miracle. It really uplifts me to hear how my systems have helped you.
The Final Version as I have it at the moment will, I think, fit all the requirements you mention in your post. It's certainly doing a lot for *me* at the moment. As I've mentioned before I am not using Colley's rule in a conventional way.
I've used the RON with N as 2, 3, 6 and 10 in the past, and you're right in that it's nothing like as powerful as Colley. It's not just a matter of finding a good choice of task in the abstract, but also of psychological readiness. And the FV majors on that.17 February 2012 at 19:19 | Mark Forster - So, Mark, what are the psychological issues that the Final Version solves?
So it's not just giving priority to the important tasks that tend to stay last in SF, and a better choice of what to work on ;)17 February 2012 at 20:25 | Mauricio - Mauricio:
A time management system is not just a way of identifying the "best" task to do next. That might work if we were computers, but we're not. The system has also to ensure that the task it identifies is one that we are psychologically ready to do.17 February 2012 at 21:00 | Mark Forster - Colley's Rule math! Version two.
I'm really convinced I've got it now. My original "cascaded lottery" concept was right on target, but I went astray when I drew its histogram as a staircase. Now, fixed.
The results are astounding! Colley's performs quite respectably versus the tedious Secretary's Rule and very similarly to the lightweight but un-Forsterish Rule of Three. I'll start off with an example, because it makes a very clear pattern.
N=5:
P(1) = 0
P(2) = 1/5 * ( 1/4 ) = 1/20
P(3) = 1/5 * ( 1/4 + 1/3 ) = 7/60
P(4) = 1/5 * ( 1/4 + 1/3 + 1/2 ) = 13/60
P(5) = 1/5 * ( 1/4 + 1/3 + 1/2 + 2 ) = 37/60
(add 'em up: 60/60)
For arbitrary N:
P(n) = 1/N * ( 1/(N-1) + 1/(N-2) + 1/(N-3) + ... + 1/(N-n) )
with special cases P(1) = 0 and P(N) = P(N-1) + 2/N
Plugging in N=3 and N=4, I get the same results I posted earlier when I wrote those cases out in full and counted them up by brute force. There was not a single equation to go wrong that time, so I'm taking it as confirmation of my new formula.
To generalize beyond specific values of N, I made a spreadsheet of N=100:
The luckiest 10% of cases land above the 98th percentile of desirable items.
The luckiest 37% land above the 88th percentile (compare to Secretary's Rule, in which they get their top applicant).
The luckiest 50% land above the 81st percentile.
The unluckiest 15% land at or below the 50th percentile.
The unluckiest 10% land at or below the 42nd percentile.
The unluckiest 5% land at or below the 30th percentile.
(The point of N=100 is *not* that N needs to be large. I just wanted a fine-grain result that does not depend on a specific N. These figures give the right general idea for small N too.)
What the variables mean:
N = # of items (e.g. houses) that meet your specification. Call them "qualified items."
P(n) = probability of the n-ranked item (out of all N) being selected by Colley's Rule,
n=1 refers to your least desirable of the N qualified items,
n=N refers to your most desirable of the N qualified items.
To use Colley's in real life and obtain these results, you do not need to know the value of N or whether it is large or small.
The logic behind this formula:
We are drawing the benchmark (we'll call its rank "b") from a 1-of-N lottery, followed by drawing the winner from a 1-of-(N-b) lottery in which items not beating the benchmark have been removed. The first lottery simulates wandering at random until we encounter the first qualified item, and the second simulates the fact that whenever we first beat the benchmark, any of the higher-ranked items are equally likely to do it. There is a special case when we draw the very best item first and are unable to beat it. The stuff I said earlier about "full N-factorial combinatorics" etc. was technically right but overly complex and not ultimately helpful.
Mathematically, the winning approach was this:
P(n selected, given benchmark b) = 1/(N-b), for b<n. It is zero for n<b or n=b<N, and it is 1 for n=b=N. Then we obtain P(n) by summing over all values of b for the given n.
Comparison to Rule of Three (R3):
R3 luckiest 6% land above 98th percentile.
R3 luckiest 32% land above 88th percentile.
R3 luckiest 50% land above 79th percentile.
R3 unluckiest 12.5% land at or below 50th percentile.
R3 unluckiest 5% land at or below 37th percentile.
(I computed using P(failing to exceed p percentile) = p*p*p)
--> Rule of Three performs quite similarly to Colley's Rule. Colley's is better at picking top choices, while R3 is better at avoiding bottom ones. Earlier comments about R3's usefulness for human to-do lists and psychological readiness are well taken and of course not reflected in these numbers.19 February 2012 at 7:33 | Bernie - In honor of dead horses everywhere, I have discovered the following:
Colley's Rule Outcome Statistics
Example for N=100:
75.745 average value
21.95 standard deviation
6.18 average # qualified items examined
(though 2/3 of the time, you will examine no more than 3 items)
Keep in mind, this is not a normal distribution (bell curve), so most conventional wisdom from stats class does not apply. The average is not the most likely result, as the most likely is N itself, and you cannot use the std. dev. to talk about three-sigma-this and four-sigma-that. These are computed means, nothing more.
Despite the 6-ish avg. # of items examined: half the time, you will examine only 2 items, and two-thirds of the time, you will examine no more than 3 items (compare to Rule of Three/Four/N). You reach the sixth item only 1/5 of the time. And strangely, that is all true regardless of N, thanks to the peculiar Harmonic Series (below).
These item counts (and the value N) do not include the unqualified items that you would reject in a real-life trial (house shopping) for failing to meet your minimum specification. But if you are comparing to other methods (Rule of Three, etc.), those same unqualified items would have to be passed over as well.
For general N:
Average value
roughly 3/4 of N (think of the middle value that beats the middle value)
actually 3N/4 + 3/4 - 1/(2N)
Standard deviation
roughly N * (7N/6 - 1) / 24 ... for large N ... as if that helps ...
actually 7N*N/144 - N/24 - 49/144 + 7/(12N) + 1/(4N*N)
Average # qualified items examined
actually 2 + 1/2 + 1/3 + 1/4 + ... + 1/(N-1), for N>2
roughly, umm, well ... http://en.wikipedia.org/wiki/Harmonic_number
intuitively, the chances of not beating benchmark in k items are 1/k, in which the highest of those k is discovered first (note how this does not depend at all on N).
Fine Print
- This is all for a pool of N "qualified" items, meaning that they meet your specification: they are all at least barely acceptable. Unqualified items have been ignored completely.
- An item's "value" is its rank, 1 to N, according to your preference scale. In practice, you do not know an item's numerical rank when you encounter it, but the rank exists for purposes of analysis, so long as you are able to identify your favorite of any two items.
- To estimate how many unqualified items would clutter up the process, you would have to posit a density of qualified items among the entire pool. For our task lists, there is no generally meaningful way of doing that, but the same items would have to be passed over using any other algorithm vs. Colley's.21 February 2012 at 17:52 | Bernie - Make tea? I've never put that one on my SF list before... ;-)
Dots by several items - I do that. I avoid multitasking but when interrupted (I answer my phone by Caller ID of a trusted few who depend on my timely advice), and I start something else, it goes in the list with a dot too. When I return to the list I look at the dotted items first to quickly get back to where I was. I don't like to leave tasks undone out of distraction or forgetfulness, only by intention.
"Funding" items - Two identical and adjacent. I've never done that either. Similar but different "Funding" item appears later - When that happens, I recognize I've got a project going even if I didn't realize it when I jotted the first item.
Don't answer anything here Mark, I like the suspense. I just had to remark on the tea idea; that's a Wholehearted Yes if I ever saw one. I'll think about that all day!23 February 2012 at 13:27 | Josef Marc - Sheer excitement! I've liberated Colley's Rule from "N":
P( top x ) = x - x*ln(x)
where x is from 0.0 to 1.0, indicating a percentile range.
Now, anyone can explore the Colley's landscape in a few seconds with only a calculator! (I can hear you all cheering ... or is that the dishwasher?)
For example,
P( top 12% ) = 0.12 - 0.12*ln(0.12) = 37% chance,
meaning that we have a 37% chance of landing in the top 12 percentiles.
Results are nearly identical to my N=100 figures posted earlier.
At the lower end of the scale,
P( bottom x ) = x + (1-x)*ln(1-x)
For a middle range, it is simplest to measure from the top:
P( top x, but below the top y ) = (x-y) - x*ln(x) + y*ln(y)
e.g., for the second-highest quintile,
P( top 0.4, but below the top 0.2 )
= (0.4-0.2) - 0.4*ln(0.4) + 0.2*ln(0.2) = 0.2446
= 24% chance of landing in the second-highest quintile
This time, the math comes from a cascade of continuous random variables:
Let benchmark "b" be a random real number from 0 to 1 (uniformly distributed).
Then, Colley's selection is another random real number from b to 1.
And presto, N has disappeared!
There is one catch: without N, there is no scenario of giving up and settling for the benchmark, which means we have implicitly assumed the search goes on and on until we beat it, no matter what. Logically, this is equivalent to assuming infinitely large N. There's always a tradeoff!
To justify this approach rigorously, we have to imagine a rating scale calibrated to the actual range of existing items (houses). That is, a 1.0 refers to your favorite of the actual existing houses that meet your specification, and a zero refers to your least-favorite of the same. In practice, you would not be able to rate the houses on this scale, since you would not be aware of the range of all houses in advance. But in principle, such a rating scale exists, and that is all we need for analysis.
This is an important point, because otherwise we might imagine that 1.0 corresponds to absolute perfection (it is math after all), and then the "top x" probabilities would be quite misleading. E.g., just because P( top 1% ) is 6%, this does not give you a 6% chance of finding an almost-perfect Mediterranean villa when shopping in the Bronx of New York.26 February 2012 at 20:48 | Bernie - Bernie: how does one take practical use of your calculations?
Josef: "Make tea" is fine, but I wouldn't include "Drink tea" lest the tea get cold before you reach that item.26 February 2012 at 21:53 | Alan Baljeu - Alan wrote:
<<Bernie: how does one take practical use of your calculations?>>
Suppose you are thinking, "I'm not sure about this Colley's Rule. I mean, pick the first one and then pick the first better one? Come *on*!! Why, it sounds barely better than a blind lottery, and I'm not letting some *lottery* influence my priorities ..." Then Mark's Final Version comes out, and you can't bring yourself to trust whichever part of it uses Colley's Rule. And then your entire 2012 is ruined.
Well, fear not! Now, with a basic calculator (as long as it has natural log), you can answer your own questions about Colley's performance. That is precisely why I started in on the equations—to convince myself—and then after being quickly converted, I continued on because it was downright fun, and I *know* I'm not the only geek on this list. I am of course joking about 2012's being ruined.
For example, if you have a several-page list with some 100 items (thus "N is large"), you might ask yourself, what are Colley's chances of pulling something in the top half of my preference/priority/whatever-Mark-is-using scale? Use the P( top x ) expression from my last post:
P( top 0.50 ) = 0.5 - 0.5 * ln(0.5) = 84.7% chance of hitting the top half of my preference scale.
What are my chances of landing poorly, in the lowest 10%?
P( bottom 0.10 ) = 0.1 + (0.9) * ln(0.9) = 0.52% (as in, half a percent!)
So it is nothing at all like "barely better than a blind lottery." Rather, it is an impressive amount of leverage gained from a minimal mental effort. So impressive, I can hardly stop toying with it and am at least as excited to see how Mark has managed to apply it as I am to see the Final Version itself. If only I were presently shopping for a house!
If you happen to have nothing like 100 items, you can still resort to my earlier expressions containing "N" to see how Colley's plays out. You'll have to add up chains of fractions, which might get old, or you might get a spreadsheet to do it. The result is very much the same as large N, letting you know that you can completely relax about the whole thing even if you haven't much idea what your "N" is.
Of course, if you have but limited faith in equations posted by strangers on the Internet, you can always go to http://www.random.org/ and see for yourself (thanks to Mark for that link!). Pull a dozen or so random numbers at a time, take the first as your benchmark, and scan for the next better one. It's amazing how high the results come out!
Now, if none of this ever bothered you in the first place—if at most you thought, "Colley's Rule, eh? Okay, I'm game"—then none of my work here will be of the slightest use to you. Except to pat you on the back for having been right all along. In particular, you do not need and cannot use any of this stuff when actually applying Colley's Rule or (I can't imagine!) the Final Version. These formulas are only for analysis.27 February 2012 at 5:42 | Bernie - Thanks for the equations, Bernie! Fun stuff!
Now if there were only some way to apply this to trading the markets...27 February 2012 at 6:43 | Seraphim - Seraphim,
<< Now if there were only some way to apply this to trading the markets...>>
There is! It just doesn't tend to make any money. ;)
Glad you enjoyed the equations.27 February 2012 at 14:11 | Bernie - Haha Nice one. You have a nice writing style. Any update on the final version of the book?12 August 2024 at 14:15 | Travor Nace