61 Matching Annotations
  1. Nov 2021
  2. Sep 2021
    1. 我们把用 G 来表示累积奖励。但 G 这个值,其实是非常不稳定的。因为互动的过程本身是有随机性的,所以在某一个状态 s 采取某一个动作 a,然后计算累积奖励,每次算出来的结果都是不一样的,所以 G 其实是一个随机变量。给同样的状态 s,给同样的动作 a,G 可能有一个固定的分布。但我们是采取采样的方式,我们在某一个状态 s 采取某一个动作 a,然后玩到底,我们看看得到多少的奖励,我们就把这个东西当作 G。把 G 想成是一个随机变量的话,我们实际上是对这个 G 做一些采样,然后拿这些采样的结果,去更新我们的参数。但实际上在某一个状态 s 采取某一个动作 a,接下来会发生什么事,它本身是有随机性的。虽然说有个固定的分布,但它本身是有随机性的,而这个随机变量的方差可能会非常大。你在同一个状态采取同一个动作,你最后得到的结果可能会是天差地远的。假设我们可以采样足够的次数,在每次更新参数之前,我们都可以采样足够的次数,那其实没有什么问题。但问题就是我们每次做 policy gradient,每次更新参数之前都要做一些采样,这个采样的次数其实是不可能太多的,我们只能够做非常少量的采样。如果你正好采样到差的结果,比如说你采样到 G = 100,采样到 G = -10,那显然你的结果会是很差的。

      这一段要好好理解。就是说给定s和a,G满足一个分布,可能方差会很大,所以G的值就会很不稳定。这就效果很差。

  3. Nov 2020
    1. busbar a and leave 6 alone on busbar a

      possibly there is a lil mistake

    2. substation

      变电站

  4. Aug 2019
  5. course-computational-literary-analysis-2019.netlify.com course-computational-literary-analysis-2019.netlify.com
    1. that was no play

      She touched the clay and the clay seemed to have a bad meaning which let everyone uncomfortable.

    2. the tip of her nose nearly met the tip of her chin.

      It's the third time that this expression appears. Maria always laughed in this way, which shows that she was a very kind person.

    3. Maria had to laugh and say she didn’t want any ring or man either

      According to the former description, Maria was a good and welcome person. But actually there were no ring or man for Maria, though she was aged and was disappointed at this, why?

    4. Then she dried her eyes and went over to the looking-glass. She dipped the end of the towel in the water-jug and refreshed her eyes with the cool water. She looked at herself in profile and readjusted a hairpin above her ear.

      There are many verbs in this paragraph. Rather than directly depicting her inner thoughts, the author described a series of her actions to show her upset and helplessness.

    5. She was sure she would win

      We can see that Mrs. Mooney is an able and confidence woman. She liked to control everything.

    6. At last, when she judged it to be the right moment, Mrs. Mooney intervened. She dealt with moral problems as a cleaver deals with meat: and in this case she had made up her mind.

      Mrs. Mooney is a very determined and mature person. This may help us understand others' characteristics and the relationship between Mrs. Mooney and other characters better.

    7. foolish blood

      "Foolish" is quite an interesting expression. It shows the narrator's adoration of her.

    8. Her dress swung as she moved her body and the soft rope of her hair tossed from side to side.

      The narrator formally depicted everything as silent and a little unlively. However, he suddenly told us such a beautiful and graceful girl. He must like her very much.

    9. When children see things like that, you know, it has an effect

      Old Cotter thought the narrator as a child. The relationship between them seemed not good.

    1. “You’re an ideal family, sir, an ideal family.”

      These words seemed to Mr. Neave more like moking than praise.

    2. if father prefers to tire himself out, I really don’t see what business of ours it is to interfere.

      Poor Mr. Neave! Even his children showed no respect and symathy towards him! They were just indifferent to him and didn't know how much their father had did for them. They might just take their happy life for granted. That made Old Neave feel more upset and hopeless.

    3. H’m, h’m! Well, well. Perhaps so...

      I think this is Mr. Neave's inner activity. Though the female family member lived a happy life, he suffered a lot to maintain that. These words show his upset and helplessness, because he was not able to change this.

    4. He stumped along, lifting his knees high as if he were walking through air that had somehow grown heavy and solid like water.

      The metaphor suggests that he was too old to move like a normal person. Also, I can also see his great powerlessness for aging.

  6. Jul 2019
    1. Up till now it had been dark, silent, beautiful very often—oh yes—but mournful somehow. Solemn. And now it would never be like that again—it had opened dazzling bright.

      There are many adjectives which depict the surroundings. Previously the surroundings had been "dark, silent, beautiful, mournful", which means that Leila was unfamiliar with the new environment and a little nervous. But now it "had opened dazzling bright", which indicates she had adapted to the environment.

    2. how simply heavenly!

      Leila was from the country and everything seemed novel and fascinating to her. The vigorous atmosphere and beautiful surroundings gave her a good impression. Different from The Garden Party, in this novel the lower class seemed to get along well with the upper class.

    3. I’ll—I’ll go with them,

      The ending is also kind of tragic and ironic, just like the other short stories. Isabel compromised at last. She had totally become "new Isabel".

    4. what colour one’s legs really were under water

      This indicates that the relationship between William and others was not close but a little distant. Maybe William was tired and stressed.

    5. It was all he could say for the moment.

      William might be indfferent to any other people. All his attention was concentrated upon Isabel.

    6. The ancient, withered creature, wearing a green satin dress, a black velvet cloak and a white hat with purple feathers, jerked slowly, slowly up the steps as though she were being drawn up on wires.

      There are many contrasts in this story. What she looked like was "ancient, withered", and she act "slowly". On the contrary, her dress was luxurious. This succesfully depicts a gambler's charater, who pursued a lot of money and was very addicted to gamble.

    7. snuffy old saints for croupiers and crowns

      The contrast between "snuffy old saints" and "croupiers and crowns" is obvious. Maybe it is to indicate the risk of losing everything in the casino.

    8. Now? Now?

      In the end, they were perplexed about the future.

    9. whispered Constantia earnestly

      She was still whispering, even she was told not to do so. She was very nervous and scared because they feared their father, even he had died.

    10. It sounded such an appallingly heartless thing to do.

      It seems that the colonel had absolute authority over his children.

    11. Silence again. There came a little rustle, a scurry, a hop.

      The averenge length of this story is shorter than that of The Moonstone and The Garden Party, I think, if we measure them. There are some sentences which only contain simple expressions, such as "silence again". Brief as they are, they create a silent atmosphere well.

    12. “Oh, how can I tell?” said Josephine crossly. “What’s the good of asking me that now?”

      I found that there are a few conversations that seem meaningless and trival. But these conversations are not of no use. They successfully show the two characters' upset and anxiety after their father's death.

    13. “Isn’t it, darling?”

      The upper classes just takes everything for granted. No matter what accident happened, they will still live a extravagant life, while the lower class will still live a poor life.

    14. smiled broadly.

      The cook's kindness was quite a contrast to what Mrs. Sheridan had decribed. Maybe this indicates that they who had a higher status sometimes had a stereotype of the workers.

    15. “Oh, I do, mother.”

      Laura made a compromise at last. Does this mean her innocence would gradually lose when she grew up?

    16. her friends rather than the silly boys she danced with and who came to Sunday night supper

      Laura cared little about others' status. Though workmen had different identity from the "silly boys” who were at the same class as her, she'd rather stay with the workmen.

    17. a long, chuckling absurd sound

      The author is good at using metaphor to protray beautiful things. He describes that the morning, the surroundings and the house are of great beauty and joy, maybe in order to create a symbol of the upper class. This may help to make preparation for the later conflicts.

    18. a silk petticoat and a kimono jacket.

      It is interesting that the characters' outlook is from different culture, like the green turban from Mideast or India, the silk from the east and the kimono from Japan. The diversity of their outlook is just like the beautiful scene around.

  7. course-computational-literary-analysis-2019.netlify.com course-computational-literary-analysis-2019.netlify.com
    1. And the married couple went to spend the honeymoon in Scotland.

      It seemed that they began to live a happy life, as the misfortune brought by the Diamond had gone. This may indicate that the mystery of the Diamond had been solved totally and everything would run normally.

    2. The Moonstone stood between him and ruin

      This is an interesting expression. If Mr. Ablewhite had not kept the Diamond, his personal reputation would be ruined. So the fact that he took the Diamond away is very reasonable.

    3. Mr. Ablewhite, senior, refused to lend his son a farthing.

      I think the reason why his father refused to lend him money might be that his father knew his actual hypocritical character, and didn't want to help him.

    4. if not legal, evidence

      That is to say, there wasn't enough evidence to prove that it was the three indians who murdered Ablewhite.

    5. her kindness and her beauty

      I think Ezra used a contrast between himself and Rachel's outlook. He described himself as ugly wrinkled face, and then praised Rachel's kindness and beauty. This admiration for Miss Rachel let me feel Rachel was a lot kinder than before.

    6. amusing himself at the billiard table

      This kind of amusing behavior usually happens when one feels nervous and trys to do something meaningless but relaxing.

    7. Sergeant Cuff.

      Till now, all of Mr. Cuff's three predictions had realized. He would come back to deal with the Diamond again. This is amazing and makes me admire Mr. Cuff more.

    8. I found the mark, and read–MY OWN NAME.

      Wow! We can make sense of all of Rosanna's strange behaviors. Before she suicided, she discovered that Franklin, the man she loved, was the actual thief. She also knew Franklin didn't realize that it was himself who stole the Diamond. So she decided to keep the truth, and with the sacrifice of herself. Besides,she asked Lucy not to give the letter to anyone but Franklin, just in order to keep others from knowing the real stoler. She was such a humble person who dedicated her poor life to the man she loved. What a tragedy!

    9. Towards sunset that evening I stood again on the well-remembered terrace,

      He was still missing Mr. Rachel and cherishing the momory there. I think this is a reason why he continued to seek the stealer.

    10. except in our good Betteredge’s own brain

      From this paragraph, we can know that Franklin thought Betteredge's discreption of him was beyond the reality. So some narration from Mr. Betteredge may be not that true.

    11. exemplary person, Miss Clack.

      I really like Mr. Bruff. Because we can find him a just and believable narrator without prejudices and too much subjective thoughts, compared with Miss Clack, who conveyed her personal dislike for Bruff in her part. So I think he is the most objective and reliable one among those who had narrated the story till now.

    12. there would be no need for me to distress Miss Rachel

      Till now, we can easily know Mr. Bruff's attitude towards other people. He thought that Mr. Godfrey was not a believable person. Besides, he sympathized with Miss Rachel and he wanted to help her.

    13. My aunt had died without opening one of the letters which I had addressed to her

      A little ironic because Miss Clack was such a pious Christian that she thought religion could cure everything, but others seemed not concerned about her advice.

    14. Christian fingers

      By searching the word Christian, nearly all of them appear in the first narrative by Miss Clack, and this word appears for a lot of times. We can easily notice that Miss Clack is a Christian and she might use the word Christian to describe good things.

    15. I could add my spiritually-wealthy relative!

      Miss Clack might regard Mr. Franklin as a person who was not so spiritually wealthy. That is quite different from what I thought about him before from Betterage's narration. And Betterage had told the reader not to believe what Miss Clark would say about him. So I think in the first narrative there will be something interesting that is different from what Betterage has said.

    16. with anger

      Why was she anger? Because of the loss of the Diamond which brought bad luck to their life? Or there was some other reasons?

    17. like a woman in a dream.

      This phrase has appeared for 4 times. It shows that Rosanna was greatly shocked and absent-minded when she heard the words by Franklin. The author depicted a lot to show Rosanna's extreme upset which maybe a lot more serious than before. Maybe he was making a pretext to what would happen later.

    18. she has taken Rosanna Spearman into her confidence

      I feel so surprised here. In the former narration, the author did not mention the relationship between Miss Verinder and Rosanna (By searching Rosanna, we seldom see Miss Verinder's appearance), but here he told us that Miss Verinder believed Rosanna very much. I admire the author's skill of telling detective stories, that he was good at creating surprises and suspenses. This makes the reader more willing to continue to read.

    19. To the gardener’s astonishment, and to my disgust, this celebrated policeman proved to be quite a mine of learning on the trumpery subject of rose-gardens.

      The appearance of Mr. Cuff seemed weird and unusual, which indicates that he was a very capable man and might make a breakthrough in the event.

    20. “Good Heavens, mamma!” cried Miss Rachel, “is this an hotel? Are there thieves in the house?”

      Haha these paragraphs around makes me laugh because Miss Rachel was so unconscious of the danger that the Diamond might be lost that it seemed bound to be lost later.

    21. when there came a sound from the terrace which, startled me out of my company manners on the instant

      Before this sentence, the author uses lots of words to describe the situations in the dinner party which I think are pretty interesting. They're roughly about Mr.Candy and Mr. Franklin, etc. But I don't think these depictions are closely related to what will happen next that they met the Indians. Actually, sometimes I do find some parts kind of fun but unrelated to the main story. This may be the author's unique personal writing style.

    22. That’s an odd girl

      These words by Franklin shows his indifferent attitude towards Rosanna, in contrast to Rosanna's unusual actions. This indicates Rosanna's tragic fate that she would not be loved by Franklin at all.

    23. To-day we love, what to-morrow we hate.

      Just by quote this short sentence from ROBINSON CRUSOE, the narrator not only reemphasizes the importance of the book to him, but also briefly and clearly shows us his decision to obey his lady.

    24. such a book as ROBINSON CRUSOE never was written, and never will be written again

      These words are quite interesting. It conveys the narrator's preference for the book.

    25. Herncastle’s fiery temper

      The author uses many words to suggest Herncastle's bad temper, such as absurdly angry, unlucky temper, fiery temper and exasperated. So by using these words, the author may successfully depict a person's characteristic very well.

    26. I must revert for a moment to the period before the assault

      In the beginning, one of the author's apparent writing styles, which can be noticed at many places, is that he tried to tell the background in a very objective but convincing way. He just chose the first person to give introduction to the background story that is kind of historical and legendary. This way of writing makes me very addicted to the story and I cannot wait to continue reading !!