## Archive for **January 2010**

## QUANT: Ito’s rule

Motivation: Given an Ito Process with dynamics . What are dynamics of ? If we know then what is ?

Ito’s rule: If *f* is sufficiently smooth, then is an Ito process and

- partials of f are evaluated at
- given
- which implies

In 2 variables:

## QUANT: Ito Processes (contd)

Ito Process is a Stochastic Process X of the form

It is the sum of an initial value , a Riemann Integral (the drift term) and an Ito Integral (the diffusion term).

Shorthand notion.

(simply take derivative of both sides)

Properties:

- is continuous in t
- is adapted to
- is a martingale if and only if for all

Stochastic Differential Equations (SDE) are a subclass of Ito Processes

where is a constant and are some functions

Example:

,

## QUANT: Ito integrals

Definition: For , let , where $\Delta t = (T-S)/N$ and define:

Properties:

- . Sum of all increments is where you end up at time T.
- Linearity. For constants a and b and processes and ,
- Time additive. For ,
- Martingales. Let X be an Ito integral, it is a stochastic process. Then we say that X is a martingale.
then where

Also, of any Ito Integral is zero.

## QUANT: Ito Processes

A stochastic process, , of the form:

Divide time interval [0, T] into N periods, of length : where

is the drift term, it is the rate of change in X per unit time

scales variance up or down

Interpretation:

random-shock is

Writing the above definition as discrete sums:

In continuous time, , it becomes

are adapted to

Note:

- is the normal/regular, Riemann Integral
- is an Ito Integral. The limit here is in or in probability

## QUANT: Brownian Motion

*Brownian motion* or *Wiener process*.

- It is a stochastic process, W
- . Initial value is 0.
- W has
*independent*increments: if , then is independent of For arbitrary times: , we have that are all independent. - W has
*Gaussian/Standard Normal*increments: if , then . So, where

- W has continuous sample paths/trajectories. is
**continuous**in t, with probability 1. (Note: not claiming differentiable)

Properties:

- W is the limit of a symmetric random walk, as step size and time interval approach zero.
- is a martingale with respect to
- is nowhere differentiable in t, with probability 1

## PROB: Game of dice

Let’s consider a game of rolling a standard, fair, six-sided die at most five times. You may stop whenever you want and receive as a reward the number of dollars corresponding to the number of dots shown on the die at the time you stop. The values at each roll will be 1, 2, 3, 4, 5, or 6, and the probability of each number on each roll is one-sixth. The objective is to find the stopping rule that will maximize the number of dollars you can expect to win on average.

If you always stop with the first roll, for example, the winnable amount is simply the expected value of a random variable that takes the values 1, 2, 3, 4, 5, and 6 with probability 1/6 each. That is, one-sixth of the time you will win 1, one-sixth of the time you will win 2, and so on, which yields the expected value 1(1/6) + 2(1/6) + 3(1/6) + 4(1/6) + 5(1/6) + 6(1/6) = 7/2. Thus if you always quit on the first roll, you expect to win 3.5 dollars on the average.

But clearly it is not optimal to stop on the first roll if it is a 1, and it is always optimal to stop with a 6, so already you know part of the optimal stopping rule. Should you stop with a 5 on the first roll?

Clearly it is optimal to stop on the first roll if the value seen on the first roll is greater than the amount expected if you do not stop—that is, if you continue to roll after rejecting the first roll. That would put you in a new game where you are only allowed four rolls, the expected value of which is also unknown at the outset. The optimal strategy in a four-roll problem, in turn, is to stop at the first roll if that value is greater than the amount you expect to win if you continue in a three-roll problem, and so on. Working down, you arrive at one strategy that you do know. In a one-roll problem there is only one strategy, namely to stop, and the expected reward is the expected value of one roll of a fair die, which we saw is 3.5. That information now yields the optimal strategy in a two-roll problem—stop on the first roll if the value is more than you expect to win if you continue, that is, more than 3.5. So now we know the optimal strategy for a two-roll problem—stop at the first roll if it is a 4, 5, or 6, and otherwise continue—and that allows us to calculate the expected reward of the strategy.

In a two-roll problem, you win 4, 5, or 6 on the very first roll, with probability 1/6 each, and stop. Otherwise (the half the time that the first roll was a 1, 2 or 3) you continue, in which case you expect to win 3.5 on the average. Thus the expected reward for the two-roll problem is 4(1/6) + 5(1/6) + 6(1/6) + (1/2)(3.5) = 4.25. This now gives you the optimal strategy for a three-roll problem—namely, stop if the first roll is a 5 or 6 (that is, more than 4.25), otherwise continue and stop only if the second roll is a 4, 5, or 6, and otherwise proceed with the final third roll. Knowing this expected reward for three rolls in turn yields the optimal strategy for a four-roll problem, and so forth. Working backwards, this yields the optimal strategy in the original five-roll problem: Stop on the first roll only if it is a 5 or 6, stop on the second roll if it is a 5 or 6, on the third roll if it is a 5 or 6, the fourth roll if it is a 4, 5 or 6, and otherwise continue to the last roll. This strategy guarantees that you will win about 5.12 Dollars on average, and no other strategy is better. (So, in a six-roll game you should stop with the initial roll only if it is a 6.)

Total number of rolls | Stop if initial roll is | Average optimal expected reward |
---|---|---|

1 | {1,2,3,4,5,6} | 3.5 |

2 | {4,5,6} | (4+5+6)/6+3.5/2 = 4.25 |

3 | {5,6} | (5+6)/6+4.25*4/6 = 4.67 |

4 | {5,6} | (5+6)/6+4.67*4/6 = 4.94 |

5 | {5,6} | (5+6)/6+4.94*4/6 = 5.13 |

## INDIA: वैष्णव जनतो

वैष्णव जन्तो तेने कहिये | पीड परायी जाने रे ||

पर दुक्खे उपकार करे | मन अभिमान ना आणे रे ||

सकळ लोकमां सहुने वन्दे | निंदा ना करे केनी रे ||

वाच काछ मन निश्छळ राखे | धन धन जननी तेनी रे ||

सम दृष्टि ने तृष्णा त्यागी | पर स्त्री जेने मात रे ||

जिह्वाथकी असत्य ना बोले | पर धन नव झाले हाथ रे ||

मोह माया व्यापे नहीं जेने | दृढ वैराग्य जेना मनमा रे ||

राम नाम शू ताले लागी | सकल तीरथ तेना तन मा रे ||

वन लोभी ने कपट रहित छे | काम क्रोध निवार्या रे ||

भणे नरसैयों तेना दर्शन करतों | कुल एकोतर तारया रे ||

He is the true Vaishnava who knows and feels another’s woes as his own

Ever ready to serve others who are unhappy, he never lets vanity get to his head

Bowing to everyone humbly and criticising none

He keeps his speech, deeds and thoughts pure; blessed is the mother who begets such a one

He looks upon all with an equal eye. Having rid himself of lust, he treats and reveres every woman as his mother

His tongue would fail him if he attempted to utter an untruth. He does not covet another’s wealth

The bonds of earthly attachment hold him not. His mind is deeply rooted in renunciation

Every moment he is intent on reciting the name of the Lord Rama. All the holy places are ever present in his body

He has conquered greed, deceit, passion (lust) and anger

The sight of such a Vaishnava, says Narsinh, saves a family through seventy-one generations