NonMetalCoin on Nostr: I thought the RLHF step tends to reward verboseness rather than brevity. Search term: ...
I thought the RLHF step tends to reward verboseness rather than brevity. Search term: “length bias”
NonMetalCoin
npub18w…x2pe5
2026-06-07 04:10:42 UTC
in reply to nevent1q…fk55
Author Public Key
npub18wtvuxz74gzwmcsv4yn7hj3dfu0xdzzwru2qtlngr32gsv0edpmsax2pe5Seen on
wss://nos.lolPublished at
2026-06-07 04:10:42 UTCEvent JSON
{
"id": "b858eecb28d554f0621e08415acdcdbd8b79294feed62f8327443885ab200883",
"pubkey": "3b96ce185eaa04ede20ca927ebca2d4f1e66884e1f1405fe681c548831f96877",
"created_at": 1780805442,
"kind": 1,
"tags": [
[
"e",
"83f70f833e703f5d58e3e6d8cb5d0ef7f5a87229c642b383d7cc4ded94aa4b0e",
"",
"root"
],
[
"e",
"aca7213e666907b0588bd48081ab12656d1f25dc8332089fe8860eaeb4efb344",
"",
"reply"
],
[
"p",
"52b4a076bcbbbdc3a1aefa3735816cf74993b1b8db202b01c883c58be7fad8bd"
],
[
"p",
"3b96ce185eaa04ede20ca927ebca2d4f1e66884e1f1405fe681c548831f96877"
],
[
"client",
"Nostur",
"31990:9be0be0fc079548233231614e4e1efc9f28b0db398011efeecf05fe570e5dd33:1685868693432"
]
],
"content": "I thought the RLHF step tends to reward verboseness rather than brevity. Search term: “length bias”",
"sig": "6738869e3a38c0075f7969e2db527babe7d8392594e7b55c1d804b7ce03fee35c7dd040b419c06aaa40267cad8cd8c188669317deb5bc60596326c4b7336ba22"
}